00000040:00080000:0.0F:1790947039.758483:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790947039.758495:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790947039.758515:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790947039.758524:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0F:1790947040.017534:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1790947041.043450:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790947042.013300:0:17169:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1790947042.013315:0:17169:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94b1f6f41000 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1790947042.013320:0:17169:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94b1f6fc6d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94b1f6f41e40 00000020:00080000:3.0:1790947042.013323:0:17169:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94b1f6fc6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94b0c5a31400 00010000:00010000:3.0:1790947042.013357:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947042.013368:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947042.013377:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947042.013383:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c28400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947042.013388:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947042.013397:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947042.013416:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94b2020f9000) 00010000:00010000:3.0:1790947042.013419:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947042.013425:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947042.013432:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28400/0xe6f6b79c2d6dea1f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790947042.013455:0:17229:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1790947042.013526:0:17229:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1790947042.062825:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947042.511015:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593948544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790947042.511097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947042.511219:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593948544 00000100:00100000:2.0:1790947042.511228:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593948544 00000100:00100000:2.0:1790947042.511273:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790947042.511282:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593948544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790947042.511319:0:17195:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790947042.511367:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593948544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947042.511374:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790947042.511432:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593948544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0F:1790947042.511709:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790947042.511727:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593948672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790947042.511759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947042.511789:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593948672 00000100:00100000:1.0:1790947042.511793:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593948672 00000100:00100000:1.0:1790947042.511818:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790947042.511825:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593948672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947042.511844:0:17194:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790947042.511903:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593948672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947042.511910:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790947042.511940:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593948672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947042.788449:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947042.788517:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573947648 00000100:00100000:1.0:1790947042.788527:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573947648 00000100:00100000:1.0:1790947042.788605:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:1.0:1790947042.788616:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+13:15558:x1877943573947648:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790947042.788715:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+13:15558:x1877943573947648:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947042.788722:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00080000:3.0:1790947042.789241:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790947042.799034:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947042.799462:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573947776 00000100:00100000:3.0:1790947042.799473:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573947776 00000100:00100000:3.0:1790947042.799554:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1790947042.799566:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:15558:x1877943573947776:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790947042.799671:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:15558:x1877943573947776:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 108us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947042.799679:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00080000:1.0:1790947042.799819:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790947042.808651:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947042.808726:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948032 00000100:00100000:2.0:1790947042.808737:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948032 00000100:00100000:2.0:1790947042.808805:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1790947042.808816:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ff09b243-35ce-4289-aa72-8fb80b1be0db+13:15558:x1877943573948032:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790947042.809068:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ff09b243-35ce-4289-aa72-8fb80b1be0db+14:15558:x1877943573948032:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 253us (425us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1790947042.809076:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1790947043.022359:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593949184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790947043.022360:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593948928:0@lo:400:kworker.0 00000100:00100000:1.0:1790947043.022763:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947043.022806:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790947043.022813:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593949312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790947043.022843:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.023112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.023155:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593948800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790947043.023199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.023333:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593949440:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.023359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.023380:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947043.023385:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593949056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947043.023409:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.023433:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949184 00000100:00100000:3.0:1790947043.023441:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949184 00000100:00100000:3.0:1790947043.023482:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949312 00000100:00100000:3.0:1790947043.023485:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949312 00000100:00100000:3.0:1790947043.024356:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593948800 00000100:00100000:3.0:1790947043.024363:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593948800 00000100:00100000:3.0:1790947043.024388:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949056 00000100:00100000:3.0:1790947043.024390:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949056 00000100:00100000:3.0:1790947043.024408:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790947043.024417:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593949184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790947043.024451:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790947043.024531:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593949184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.024538:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790947043.024557:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790947043.024563:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593949312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790947043.024572:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790947043.024595:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593949312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.024601:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790947043.024612:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790947043.024617:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593948800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790947043.024632:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947043.024664:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593948800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.024670:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790947043.024680:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790947043.024686:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593949056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790947043.024696:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947043.024719:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593949056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.024724:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790947043.024758:0:17184:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593948928 00000100:00100000:3.0:1790947043.024762:0:17184:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593948928 00000100:00100000:2.0:1790947043.025080:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877943593949824:0@lo:400:kworker.0 00000100:00100000:2.0:1790947043.025113:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947043.025153:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593950336:0@lo:400:kworker.0 00000100:00100000:2.0:1790947043.025172:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947043.025202:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790947043.025208:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593949696:0@lo:400:kworker.0 00000100:00100000:2.0:1790947043.025249:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947043.025268:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1877943593950208:0@lo:400:kworker.0 00000100:00100000:2.0:1790947043.025286:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947043.025322:0:17930:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949440 00000100:00100000:2.0:1790947043.025326:0:17930:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949440 00000100:00100000:2.0:1790947043.025356:0:17930:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949696 00000100:00100000:2.0:1790947043.025358:0:17930:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949696 00000100:00100000:2.0:1790947043.025370:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790947043.025376:0:17930:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593949440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.025671:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790947043.025679:0:17184:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3641:x1877943593948928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.025716:0:17184:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3641:x1877943593948928:12345-0@lo:400:kworker.0 Request processed in 39us (2604us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.025728:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790947043.025784:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877943593949568:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.025816:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.025835:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593950080:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.025853:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.025883:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790947043.025888:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593949952:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.025907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947043.025926:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949824 00000100:00100000:3.0:1790947043.025930:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949824 00000100:00100000:3.0:1790947043.025948:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950336 00000100:00100000:3.0:1790947043.025950:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950336 00000100:00100000:3.0:1790947043.025963:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950208 00000100:00100000:3.0:1790947043.025965:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950208 00000100:00100000:3.0:1790947043.025976:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949568 00000100:00100000:3.0:1790947043.025978:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949568 00000100:00100000:3.0:1790947043.025988:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950080 00000100:00100000:3.0:1790947043.025990:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950080 00000100:00100000:3.0:1790947043.025999:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593949952 00000100:00100000:3.0:1790947043.026001:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593949952 00000100:00100000:3.0:1790947043.026013:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790947043.026019:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877943593949824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026058:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877943593949824:12345-0@lo:400:kworker.0 Request processed in 38us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026064:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790947043.026076:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790947043.026082:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877943593950336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026138:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877943593950336:12345-0@lo:400:kworker.0 Request processed in 55us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026145:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790947043.026156:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790947043.026162:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877943593950208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026186:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877943593950208:12345-0@lo:400:kworker.0 Request processed in 25us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026191:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790947043.026202:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790947043.026207:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877943593949568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026368:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877943593949568:12345-0@lo:400:kworker.0 Request processed in 160us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026374:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790947043.026385:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790947043.026391:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877943593950080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026417:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877943593950080:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026423:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790947043.026433:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790947043.026440:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593949952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026467:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593949952:12345-0@lo:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026473:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790947043.026512:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593949952:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026534:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877943593949568:0@lo:400:kworker.0 00010000:00080000:3.0:1790947043.026546:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1f6d20a80 x1877943593950080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947043.026557:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593950080:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026602:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593949312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947043.026618:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593949184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790947043.026655:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593949056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947043.026666:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593948928:0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026680:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593948800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790947043.026725:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790947043.026733:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593949696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947043.026767:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593949696:12345-0@lo:400:kworker.0 Request processed in 35us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.026774:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790947043.026929:0:17930:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593949440:12345-0@lo:400:kworker.0 Request processed in 1552us (3567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947043.026937:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790947043.026967:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593949696:0@lo:400:kworker.0 00000100:00100000:2.0:1790947043.026979:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1877943593950208:0@lo:400:kworker.0 00000100:00100000:2.0:1790947043.026990:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877943593949824:0@lo:400:kworker.0 00010000:00080000:2.0:1790947043.027001:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1f6d20000 x1877943593950336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947043.027010:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593950336:0@lo:400:kworker.0 00000100:00080000:1.0:1790947043.027187:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790947043.027192:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790947043.027196:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790947043.027199:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790947043.028128:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593949440:0@lo:400:kworker.0 00010000:00010000:2.0:1790947043.086439:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947043.269728:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947043.269779:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947043.269801:0:17182:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948160 00000100:00100000:3.0:1790947043.269811:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947043.269812:0:17182:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948160 00000100:00100000:3.0:1790947043.269844:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947043.269893:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:0.0:1790947043.269899:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948416 00000100:00100000:2.0:1790947043.269904:0:17182:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13b8f25-4250-4693-8909-496a41838f7a+13:2402:x1877943573948160:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947043.269904:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948416 00000100:00100000:0.0:1790947043.269933:0:19849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948288 00000100:00100000:0.0:1790947043.269935:0:19849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948288 00000100:00100000:0.0:1790947043.269953:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:0.0:1790947043.269958:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2402:x1877943573948416:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947043.269969:0:17182:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13b8f25-4250-4693-8909-496a41838f7a+13:2402:x1877943573948160:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947043.269987:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2402:x1877943573948416:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947043.269990:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:0.0:1790947043.269993:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:0.0:1790947043.270004:0:19849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:0.0:1790947043.270009:0:19849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ff09b243-35ce-4289-aa72-8fb80b1be0db+14:2402:x1877943573948288:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947043.270037:0:19849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ff09b243-35ce-4289-aa72-8fb80b1be0db+14:2402:x1877943573948288:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947043.270043:0:19849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:2.0:1790947043.277341:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947043.277385:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947043.277457:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948928 00000100:00100000:3.0:1790947043.277466:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948928 00000100:00100000:3.0:1790947043.277538:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948800 00000100:00100000:3.0:1790947043.277559:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948800 00000100:00100000:3.0:1790947043.277588:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:3.0:1790947043.277598:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2403:x1877943573948928:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:2.0:1790947043.277671:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790947043.277675:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790947043.277895:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2403:x1877943573948928:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 285us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.277904:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:3.0:1790947043.277922:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1790947043.277929:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+6:2403:x1877943573948800:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1790947043.277955:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+6:2403:x1877943573948800:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947043.277961:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:2.0:1790947043.278177:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947043.281321:0:19256:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948544 00000100:00100000:0.0:1790947043.281338:0:19256:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948544 00000100:00100000:0.0:1790947043.281439:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1790947043.281449:0:19256:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2402:x1877943573948544:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947043.281534:0:19256:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2402:x1877943573948544:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 86us (11688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947043.281542:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1790947043.281816:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947043.281838:0:18697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573948672 00000100:00100000:2.0:1790947043.281843:0:18697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573948672 00000100:00100000:2.0:1790947043.281900:0:18697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949056 00000100:00100000:2.0:1790947043.281904:0:18697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949056 00000100:00100000:2.0:1790947043.281926:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:2.0:1790947043.281933:0:18697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2401:x1877943573948672:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1790947043.281954:0:18697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de755 00000100:00080000:2.0:1790947043.281969:0:18697:0:(import.c:65:import_set_state_nolock()) ffff94b0c8692800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790947043.282021:0:18697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790947043.282194:0:18697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ff09b243-35ce-4289-aa72-8fb80b1be0db+2:2401:x1877943573948672:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 260us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947043.282200:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:2.0:1790947043.282213:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:2.0:1790947043.282219:0:18697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2401:x1877943573949056:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1790947043.282230:0:18697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de78d 00000100:00080000:2.0:1790947043.282237:0:18697:0:(import.c:65:import_set_state_nolock()) ffff94b1fcd19800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790947043.282264:0:18697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790947043.282332:0:18697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+2:2401:x1877943573949056:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 113us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947043.282354:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00010000:00010000:2.0:1790947043.282375:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947043.282435:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947043.282450:0:18697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949184 00000100:00100000:2.0:1790947043.282454:0:18697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949184 00000100:00100000:2.0:1790947043.282475:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:2.0:1790947043.282482:0:18697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2401:x1877943573949184:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1790947043.282494:0:18697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de794 00000100:00080000:2.0:1790947043.282499:0:18697:0:(import.c:65:import_set_state_nolock()) ffff94b1fcd75800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790947043.282518:0:18697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790947043.282568:0:18697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+2:2401:x1877943573949184:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 86us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947043.282576:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00010000:00010000:2.0:1790947043.282590:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947043.282975:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790947043.283081:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790947043.283086:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1790947043.662664:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790947044.112788:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790947044.687171:0:20567:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:17:23 (1790947043) 00010000:00010000:2.0:1790947045.135438:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947046.158130:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947047.182014:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947047.630899:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947047.630922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593950464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947047.630994:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947047.632396:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593950592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790947047.632452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947047.632682:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950464 00000100:00100000:2.0:1790947047.632690:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950464 00000100:00100000:2.0:1790947047.632737:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950592 00000100:00100000:2.0:1790947047.632740:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950592 00000100:00100000:2.0:1790947047.632753:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790947047.632762:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593950464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790947047.632797:0:17194:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790947047.632843:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593950464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947047.632850:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790947047.632887:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790947047.632893:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593950592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790947047.632926:0:17194:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790947047.632954:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593950592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947047.632960:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790947047.633295:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593950592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790947047.633311:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593950464:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1790947047.637638:0:17169:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1790947047.637655:0:17169:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1790947047.637891:0:17229:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1790947047.637905:0:17229:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:1.0:1790947048.142290:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593950976:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.142376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.142415:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593951488:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.142438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.142457:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1877943593952000:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.142481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.142506:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790947048.142512:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593951104:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.142532:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.142546:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593951616:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.142565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.142581:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1877943593952128:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.142601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.142631:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950976 00000100:00100000:1.0:1790947048.142640:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950976 00000100:00100000:1.0:1790947048.142694:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951488 00000100:00100000:1.0:1790947048.142697:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951488 00000100:00100000:1.0:1790947048.142711:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951104 00000100:00100000:1.0:1790947048.142713:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951104 00000100:00100000:1.0:1790947048.142724:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951616 00000100:00100000:1.0:1790947048.142928:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951616 00000100:00100000:1.0:1790947048.142963:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790947048.142972:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593950976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143024:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593950976:12345-0@lo:400:kworker.0 Request processed in 53us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.143032:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790947048.143048:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790947048.143054:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593951488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143091:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593951488:12345-0@lo:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.143097:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790947048.143108:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790947048.143114:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c65e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593951104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143139:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c65e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593951104:12345-0@lo:400:kworker.0 Request processed in 25us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.143144:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790947048.143155:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790947048.143160:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593951616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143183:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593951616:12345-0@lo:400:kworker.0 Request processed in 23us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.143189:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790947048.143208:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952000 00000100:00100000:1.0:1790947048.143211:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952000 00000100:00100000:1.0:1790947048.143233:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952128 00000100:00100000:1.0:1790947048.143236:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952128 00000100:00100000:1.0:1790947048.143251:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790947048.143257:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c65e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877943593952000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143401:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c65e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877943593952000:12345-0@lo:400:kworker.0 Request processed in 50us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.143410:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790947048.143423:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790947048.143430:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877943593952128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143459:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877943593952128:12345-0@lo:400:kworker.0 Request processed in 31us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.143465:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1790947048.143485:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790947048.143489:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790947048.143492:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790947048.143493:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790947048.143522:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593951104:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143533:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593951616:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143541:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1877943593952128:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143551:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593950976:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143559:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593951488:0@lo:400:kworker.0 00010000:00080000:1.0:1790947048.143570:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7c80e00 x1877943593952000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947048.143579:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1877943593952000:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.143588:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593950848:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.143629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.143658:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593951360:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.143677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.143694:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1877943593951872:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143707:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950848 00000100:00100000:1.0:1790947048.143711:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950848 00000100:00100000:0.0:1790947048.143713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.143731:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790947048.143737:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3640:1877943593950720:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.143763:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.143782:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593951232:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.143802:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.143817:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877943593951744:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143823:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951360 00000100:00100000:1.0:1790947048.143826:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951360 00000100:00100000:0.0:1790947048.143839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.143849:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790947048.143850:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593952256:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143855:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593950848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143906:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593950848:12345-0@lo:400:kworker.0 Request processed in 51us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.143906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.143912:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790947048.143924:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790947048.143924:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593950848:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.143929:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593951360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.143943:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951872 00000100:00100000:0.0:1790947048.143947:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951872 00000100:00100000:0.0:1790947048.143972:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951232 00000100:00100000:0.0:1790947048.143975:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951232 00000100:00100000:0.0:1790947048.143985:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593951744 00000100:00100000:0.0:1790947048.143987:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593951744 00000100:00100000:0.0:1790947048.143997:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952256 00000100:00100000:0.0:1790947048.143999:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952256 00000100:00100000:0.0:1790947048.144011:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790947048.144013:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593951360:12345-0@lo:400:kworker.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.144016:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877943593951872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.144019:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790947048.144045:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877943593951872:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.144046:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790947048.144051:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790947048.144052:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593951232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.144062:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790947048.144067:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877943593951744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.144089:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593951232:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.144095:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790947048.144100:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877943593951744:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.144105:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790947048.144108:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790947048.144113:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877943593952256:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790947048.144116:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790947048.144119:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790947048.144134:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593951232:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.144139:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877943593952256:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.144143:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877943593951744:0@lo:400:kworker.0 00000100:00100000:1.0:1790947048.144145:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1790947048.144151:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7c81f80 x1877943593952256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947048.144172:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593952256:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.144183:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593951360:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.144191:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1877943593951872:0@lo:400:kworker.0 00000100:00100000:3.0:1790947048.144623:0:17183:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593950720 00000100:00100000:3.0:1790947048.144629:0:17183:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593950720 00000100:00100000:3.0:1790947048.144663:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790947048.144669:0:17183:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3640:x1877943593950720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947048.144709:0:17183:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3640:x1877943593950720:12345-0@lo:400:kworker.0 Request processed in 41us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947048.144716:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790947048.144756:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593952384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790947048.144786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.144812:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3640:1877943593950720:0@lo:400:kworker.0 00000100:00100000:0.0:1790947048.144845:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952384 00000100:00100000:0.0:1790947048.144848:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952384 00000100:00100000:2.0:1790947048.144881:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947048.144886:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790947048.144890:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593952512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790947048.144893:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593952384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790947048.144916:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790947048.144919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.144949:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593952384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.144955:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790947048.144966:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952512 00000100:00100000:0.0:1790947048.144969:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952512 00000100:00100000:0.0:1790947048.144983:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790947048.144989:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593952512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790947048.145003:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790947048.147060:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593952768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947048.147132:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947048.147192:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593952512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2201us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.147203:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790947048.147230:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952768 00000100:00100000:0.0:1790947048.147251:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952768 00000100:00100000:3.0:1790947048.147278:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790947048.147283:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790947048.147291:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593952768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790947048.147313:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790947048.147353:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593952768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.147354:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593952384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790947048.147359:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790947048.148567:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593952768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947048.149167:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593952640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947048.149237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947048.149402:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952640 00000100:00100000:1.0:1790947048.149409:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952640 00000100:00100000:1.0:1790947048.149458:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790947048.149474:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593952640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790947048.149497:0:18699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790947048.149548:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593952640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.149554:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790947048.149627:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593952640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790947048.151319:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593952512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790947048.206106:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947048.387296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.387451:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.387482:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.387511:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.387537:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.387563:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.387587:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949568 00000100:00100000:0.0:1790947048.387596:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949568 00000100:00100000:0.0:1790947048.387650:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949824 00000100:00100000:0.0:1790947048.387654:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949824 00000100:00100000:0.0:1790947048.387667:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949440 00000100:00100000:0.0:1790947048.387669:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949440 00000100:00100000:0.0:1790947048.387680:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949952 00000100:00100000:0.0:1790947048.387682:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949952 00000100:00100000:0.0:1790947048.387696:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1790947048.387705:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2405:x1877943573949568:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947048.387776:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2405:x1877943573949568:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.387783:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1790947048.387801:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:0.0:1790947048.387807:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+6:2405:x1877943573949824:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947048.387894:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+6:2405:x1877943573949824:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 87us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.387901:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:0.0:1790947048.387914:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:0.0:1790947048.387920:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ff09b243-35ce-4289-aa72-8fb80b1be0db+13:2405:x1877943573949440:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947048.387963:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ff09b243-35ce-4289-aa72-8fb80b1be0db+13:2405:x1877943573949440:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 43us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.387970:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:0.0:1790947048.387982:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:0.0:1790947048.387988:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2405:x1877943573949952:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947048.388009:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2405:x1877943573949952:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 21us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.388015:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00080000:0.0:1790947048.388042:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790947048.388046:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790947048.388055:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949696 00000100:00100000:0.0:1790947048.388058:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949696 00000100:00100000:0.0:1790947048.388097:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1790947048.388104:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2405:x1877943573949696:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947048.388130:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2405:x1877943573949696:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.388136:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00080000:0.0:1790947048.388149:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947048.391173:0:17184:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573949312 00000100:00100000:2.0:1790947048.391187:0:17184:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573949312 00000100:00100000:2.0:1790947048.391317:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:2.0:1790947048.391328:0:17184:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13b8f25-4250-4693-8909-496a41838f7a+13:2405:x1877943573949312:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947048.391403:0:17184:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13b8f25-4250-4693-8909-496a41838f7a+13:2405:x1877943573949312:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 77us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947048.391411:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 173 00000001:00100000:1.0:1790947048.657746:0:18692:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000020:00000080:1.0:1790947048.657755:0:18692:0:(genops.c:885:class_export_put()) final put ffff94b1fcd1e800/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000020:00000080:2.0:1790947048.658341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fcd1e800/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 for lustre-OST0000 00000020:00000080:2.0:1790947048.658405:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fcd19800 for lustre-OST0000 00000001:00100000:3.0:1790947048.661333:0:19509:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000020:00000080:3.0:1790947048.661342:0:19509:0:(genops.c:885:class_export_put()) final put ffff94b1fcd75000/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000001:00100000:3.0:1790947048.661369:0:19509:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ff09b243-35ce-4289-aa72-8fb80b1be0db 00000020:00000080:3.0:1790947048.661372:0:19509:0:(genops.c:885:class_export_put()) final put ffff94b1fcd18800/ff09b243-35ce-4289-aa72-8fb80b1be0db 00000020:00000080:1.0:1790947048.661518:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fcd75000/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 for lustre-OST0001 00000020:00000080:1.0:1790947048.661576:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fcd18800/ff09b243-35ce-4289-aa72-8fb80b1be0db for lustre-OST0001 00000020:00000080:1.0:1790947048.661601:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fcd75800 for lustre-OST0001 00000020:00000080:1.0:1790947048.661606:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c8692800 for lustre-OST0001 00000100:00100000:0.0:1790947048.957846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947048.958156:0:17193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573950208 00000100:00100000:2.0:1790947048.958166:0:17193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573950208 00000100:00100000:2.0:1790947048.958227:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1790947048.958238:0:17193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ff09b243-35ce-4289-aa72-8fb80b1be0db+13:16313:x1877943573950208:12345-192.168.203.29@tcp:35:umount.0 00000001:00080000:2.0:1790947048.958638:0:17193:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1790947048.958724:0:17193:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1790947048.959112:0:17193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ff09b243-35ce-4289-aa72-8fb80b1be0db+16:16313:x1877943573950208:12345-192.168.203.29@tcp:35:umount.0 Request processed in 873us (1272us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1790947048.959132:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000020:00080000:2.0:1790947048.959138:0:17193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790947048.964030:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947048.964081:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.964210:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573950336 00000100:00100000:0.0:1790947048.964236:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573950336 00000100:00100000:0.0:1790947048.964297:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573950464 00000100:00100000:0.0:1790947048.964301:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573950464 00000100:00100000:0.0:1790947048.964319:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1790947048.964327:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13b8f25-4250-4693-8909-496a41838f7a+14:2405:x1877943573950336:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790947048.964342:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947048.964371:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c646a200/0xe6f6b79c2d6de72b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ee97 expref: 14 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947048.964390:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947048.964447:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13b8f25-4250-4693-8909-496a41838f7a+13:2405:x1877943573950336:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 120us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.964454:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1790947048.964470:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1790947048.964476:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13b8f25-4250-4693-8909-496a41838f7a+12:2405:x1877943573950464:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790947048.964483:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947048.964491:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223000/0xe6f6b79c2d6de732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0eec8 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947048.964500:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947048.964515:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13b8f25-4250-4693-8909-496a41838f7a+11:2405:x1877943573950464:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 40us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947048.964521:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1790947048.972250:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947048.972388:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573950592 00000100:00100000:3.0:1790947048.972399:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573950592 00000100:00100000:3.0:1790947048.972467:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1790947048.972477:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1ef8dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13b8f25-4250-4693-8909-496a41838f7a+11:2404:x1877943573950592:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947048.972493:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947048.972512:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ecb47400/0xe6f6b79c2d6de7b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef7e expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947048.972532:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947048.972594:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1ef8dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13b8f25-4250-4693-8909-496a41838f7a+10:2404:x1877943573950592:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 117us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947048.972602:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1790947048.978832:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947048.979192:0:19256:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573950720 00000100:00100000:1.0:1790947048.979203:0:19256:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573950720 00000100:00100000:1.0:1790947048.979262:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1790947048.979273:0:19256:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2401:x1877943573950720:12345-192.168.203.29@tcp:9:umount.0 00000020:00000080:1.0:1790947048.979311:0:19256:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de74e 00000100:00080000:1.0:1790947048.979321:0:19256:0:(import.c:65:import_set_state_nolock()) ffff94b1fcd1b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790947048.979376:0:19256:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790947048.979536:0:19256:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+2:2401:x1877943573950720:12345-192.168.203.29@tcp:9:umount.0 Request processed in 263us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947048.979544:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00010000:00010000:3.0:1790947048.980414:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947048.990625:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947048.990742:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573951616 00000100:00100000:0.0:1790947048.990753:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573951616 00000100:00100000:0.0:1790947048.990823:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:0.0:1790947048.990835:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ff09b243-35ce-4289-aa72-8fb80b1be0db+16:2401:x1877943573951616:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1790947048.990914:0:17189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de740 00000020:00010000:0.0:1790947048.990930:0:17189:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94b1eee2a800: total 0 00000100:00080000:0.0:1790947048.990935:0:17189:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790947048.990964:0:17189:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1790947048.991131:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ff09b243-35ce-4289-aa72-8fb80b1be0db+15:2401:x1877943573951616:12345-192.168.203.29@tcp:39:umount.0 Request processed in 299us (514us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1790947048.991140:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000020:00010000:2.0:1790947048.991322:0:19582:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94b1eee2a800: total 0 00010000:00010000:2.0:1790947048.991326:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947048.991378:0:19582:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94b1eee2a800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1790947048.991414:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94b2020f9c00) 00010000:00010000:2.0:1790947048.991418:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790947048.991427:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6de80b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef85 expref: 14 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991451:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94b2020f9000) 00010000:00010000:2.0:1790947048.991454:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790947048.991458:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28e00/0xe6f6b79c2d6de9f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f018 expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991474:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:2.0:1790947048.991476:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790947048.991480:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c646bc00/0xe6f6b79c2d6dea50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f034 expref: 12 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991491:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94b1d8aa0c00) 00010000:00010000:2.0:1790947048.991493:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790947048.991497:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c646b600/0xe6f6b79c2d6de8eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0efc4 expref: 11 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991510:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:2.0:1790947048.991513:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790947048.991525:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601600/0xe6f6b79c2d6de99a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f003 expref: 10 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991546:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:2.0:1790947048.991550:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790947048.991553:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c646a600/0xe6f6b79c2d6de969 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0efee expref: 9 pid: 19849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991569:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94b2020f9a00) 00010000:00010000:2.0:1790947048.991571:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790947048.991575:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6de827 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef8c expref: 8 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991587:0:19582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1fe380000) 00010000:00010000:2.0:1790947048.991589:0:19582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790947048.991593:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c646b000/0xe6f6b79c2d6de866 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef9a expref: 7 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947048.991603:0:19582:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94b1eee2a800, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1790947048.991617:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947048.991618:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947048.991620:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947049.005567:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947049.005650:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573951744 00000100:00100000:3.0:1790947049.005721:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573951744 00000100:00100000:3.0:1790947049.005995:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:3.0:1790947049.006007:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+5:2401:x1877943573951744:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:3.0:1790947049.006043:0:18466:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de747 00000100:00080000:3.0:1790947049.006061:0:18466:0:(import.c:65:import_set_state_nolock()) ffff94b1fcd1f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790947049.006112:0:18466:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1790947049.006343:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ff09b243-35ce-4289-aa72-8fb80b1be0db+3:2401:x1877943573951744:12345-192.168.203.29@tcp:39:umount.0 Request processed in 338us (785us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790947049.006367:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00010000:00010000:2.0:1790947049.006812:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947049.230169:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947049.998106:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790947049.998127:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790947049.998147:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790947049.998156:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1790947050.254110:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947051.278084:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947051.561033:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947051.561087:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947051.561121:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947051.563438:0:17174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573951872 00000100:00100000:2.0:1790947051.563454:0:17174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573951872 00000100:00100000:2.0:1790947051.563514:0:17174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573952128 00000100:00100000:2.0:1790947051.563517:0:17174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573952128 00000100:00100000:2.0:1790947051.563545:0:17174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573952000 00000100:00100000:2.0:1790947051.563548:0:17174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573952000 00000100:00100000:2.0:1790947051.563569:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1790947051.563578:0:17174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13b8f25-4250-4693-8909-496a41838f7a+12:2404:x1877943573951872:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947051.563594:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947051.563616:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c646a800/0xe6f6b79c2d6de76a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef07 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947051.563634:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947051.563711:0:17174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13b8f25-4250-4693-8909-496a41838f7a+11:2404:x1877943573951872:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 134us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947051.565173:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1790947051.565214:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1790947051.565228:0:17174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13b8f25-4250-4693-8909-496a41838f7a+10:2404:x1877943573952128:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947051.565246:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947051.565263:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c28800/0xe6f6b79c2d6de7b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef77 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947051.565278:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947051.566266:0:17174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13b8f25-4250-4693-8909-496a41838f7a+9:2404:x1877943573952128:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 1036us (5172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947051.566276:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1790947051.567139:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1790947051.567159:0:17174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13b8f25-4250-4693-8909-496a41838f7a+8:2404:x1877943573952000:12345-192.168.203.29@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790947051.567162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:2.0:1790947051.567181:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947051.567202:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6de771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ef38 expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947051.567225:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947051.567263:0:17174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13b8f25-4250-4693-8909-496a41838f7a+7:2404:x1877943573952000:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 111us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947051.567268:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573952384 00000100:00100000:2.0:1790947051.567273:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1790947051.567277:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573952384 00000100:00100000:0.0:1790947051.567338:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:0.0:1790947051.567347:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+6:2401:x1877943573952384:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1790947051.567383:0:17191:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de77f 00000020:00010000:0.0:1790947051.567391:0:17191:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94b0c8691800: total 0 00000100:00080000:0.0:1790947051.567396:0:17191:0:(import.c:65:import_set_state_nolock()) ffff94b0c8696800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790947051.567419:0:17191:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1790947051.567535:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2401:x1877943573952384:12345-192.168.203.29@tcp:39:umount.0 Request processed in 189us (374us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1790947051.567542:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00080000:0.0:1790947051.567561:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1790947051.567569:0:17178:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94b0c8691800: total 0 00010000:00010000:0.0:1790947051.567612:0:17178:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94b0c8691800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790947051.567637:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1fe380000) 00010000:00010000:0.0:1790947051.567641:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790947051.567654:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6de874 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0efa1 expref: 4 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947051.567676:0:17178:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94b0c8691800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790947051.567690:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947051.567692:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947051.567693:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947051.578432:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947051.579892:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573952512 00000100:00100000:1.0:1790947051.579905:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573952512 00000100:00080000:0.0:1790947051.580062:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790947051.581847:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:1.0:1790947051.581888:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+5:2401:x1877943573952512:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:1.0:1790947051.581949:0:17190:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de786 00000100:00080000:1.0:1790947051.581960:0:17190:0:(import.c:65:import_set_state_nolock()) ffff94b0c67d8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790947051.581992:0:17190:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1790947051.582167:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3+3:2401:x1877943573952512:12345-192.168.203.29@tcp:39:umount.0 Request processed in 307us (3744us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790947051.582175:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00010000:00010000:2.0:1790947051.583066:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947051.615416:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947051.615519:0:17182:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573952768 00000100:00100000:2.0:1790947051.615531:0:17182:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573952768 00000100:00100000:2.0:1790947051.615592:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:2.0:1790947051.615602:0:17182:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13b8f25-4250-4693-8909-496a41838f7a+7:2401:x1877943573952768:12345-192.168.203.29@tcp:251:umount.0 00000020:00000080:2.0:1790947051.615648:0:17182:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de71d 00000020:00010000:2.0:1790947051.615657:0:17182:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94b0c1613800: total 0 00000100:00080000:2.0:1790947051.615662:0:17182:0:(import.c:65:import_set_state_nolock()) ffff94b0c1611800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790947051.615743:0:17182:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13b8f25-4250-4693-8909-496a41838f7a+3:2401:x1877943573952768:12345-192.168.203.29@tcp:251:umount.0 Request processed in 143us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947051.615751:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 174 00000020:00010000:0.0:1790947051.615983:0:17177:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94b0c1613800: total 0 00010000:00010000:0.0:1790947051.616038:0:17177:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94b0c1613800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790947051.616081:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7601400/0xe6f6b79c2d6de724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0ee90 expref: 2 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947051.616096:0:17177:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94b0c1613800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790947051.616121:0:17177:0:(genops.c:885:class_export_put()) final put ffff94b0c1613800/c13b8f25-4250-4693-8909-496a41838f7a 00010000:00010000:0.0:1790947051.616140:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947051.616142:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947051.616144:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790947051.616176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c1613800/c13b8f25-4250-4693-8909-496a41838f7a for MGS 00000020:00000080:2.0:1790947051.616217:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c1611800 for MGS 00010000:00010000:0.0:1790947052.302119:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947052.750912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593952896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790947052.750990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947052.751093:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593952896 00000100:00100000:1.0:1790947052.751102:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593952896 00000100:00100000:1.0:1790947052.751154:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790947052.751163:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593952896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947052.751200:0:17195:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790947052.751251:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593952896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947052.751259:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790947052.751303:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593952896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790947052.751544:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790947052.751556:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593953024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790947052.751588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947052.751643:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953024 00000100:00100000:2.0:1790947052.751647:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953024 00000100:00100000:2.0:1790947052.751678:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790947052.751686:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593953024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790947052.751706:0:17194:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790947052.751747:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593953024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947052.751759:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790947052.752251:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593953024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790947053.262170:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593953152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790947053.262349:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947053.262403:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953152 00000100:00100000:1.0:1790947053.262411:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953152 00000100:00100000:1.0:1790947053.262461:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790947053.262470:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593953152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790947053.262497:0:18699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790947053.262550:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593953152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947053.262557:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790947053.262633:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790947053.262670:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593953152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790947053.263926:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593953280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790947053.263972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947053.264014:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790947053.264021:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593953408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790947053.264060:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947053.264280:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593953536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790947053.264310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.264568:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953280 00000100:00100000:0.0:1790947053.264576:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953280 00000100:00100000:0.0:1790947053.264621:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953408 00000100:00100000:0.0:1790947053.264624:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953408 00000100:00100000:0.0:1790947053.264638:0:18699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953536 00000100:00100000:0.0:1790947053.264640:0:18699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953536 00000100:00100000:0.0:1790947053.264654:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790947053.264662:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593953280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790947053.264688:0:18699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790947053.264740:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593953280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.264759:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790947053.264775:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790947053.264781:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593953408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790947053.264792:0:18699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790947053.264820:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593953408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.264825:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790947053.264836:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790947053.264842:0:18699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593953536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790947053.264851:0:18699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790947053.264919:0:18699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593953536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.264924:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790947053.265172:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593953920:0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947053.265230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7fb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593954432:0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265248:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947053.265264:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790947053.265269:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593953792:0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265287:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947053.265310:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1877943593954304:0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947053.265346:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953920 00000100:00100000:3.0:1790947053.265350:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953920 00000100:00100000:3.0:1790947053.265374:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954432 00000100:00100000:3.0:1790947053.265376:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954432 00000100:00100000:3.0:1790947053.265389:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954304 00000100:00100000:3.0:1790947053.265391:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954304 00000100:00100000:3.0:1790947053.265402:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790947053.265407:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593953920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265448:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593953920:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947053.265455:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790947053.265466:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790947053.265471:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593954432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265491:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593954432:12345-0@lo:400:kworker.0 Request processed in 21us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947053.265496:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790947053.265505:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790947053.265510:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877943593954304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265528:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877943593954304:12345-0@lo:400:kworker.0 Request processed in 19us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947053.265533:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790947053.265549:0:17930:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953792 00000100:00100000:3.0:1790947053.265552:0:17930:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953792 00000100:00100000:3.0:1790947053.265571:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790947053.265576:0:17930:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593953792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265602:0:17930:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593953792:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947053.265607:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790947053.265642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593953792:0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265650:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1877943593954304:0@lo:400:kworker.0 00000100:00100000:3.0:1790947053.265657:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593953920:0@lo:400:kworker.0 00010000:00080000:3.0:1790947053.265666:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7fb9880 x1877943593954432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947053.265682:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7fb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593954432:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266434:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3642:1877943593953664:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.266501:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593954176:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.266535:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1877943593954688:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.266564:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790947053.266569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f6d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593954048:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.266599:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1877943593954560:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266614:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.266643:0:17184:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593953664 00000100:00100000:0.0:1790947053.266647:0:17184:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593953664 00000100:00100000:0.0:1790947053.266673:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790947053.266679:0:17184:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3642:x1877943593953664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266711:0:17184:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3642:x1877943593953664:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.266717:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790947053.266742:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954048 00000100:00100000:0.0:1790947053.266745:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954048 00000100:00100000:0.0:1790947053.266763:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790947053.266769:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593954048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266798:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593954048:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.266804:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790947053.266832:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593954048:0@lo:400:kworker.0 00000100:00100000:0.0:1790947053.266840:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3642:1877943593953664:0@lo:400:kworker.0 00000100:00100000:1.0:1790947053.267186:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954176 00000100:00100000:1.0:1790947053.267191:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954176 00000100:00100000:1.0:1790947053.267237:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954688 00000100:00100000:1.0:1790947053.267241:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954688 00000100:00100000:1.0:1790947053.267254:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954560 00000100:00100000:1.0:1790947053.267256:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954560 00000100:00100000:1.0:1790947053.267269:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790947053.267274:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593954176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947053.267312:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593954176:12345-0@lo:400:kworker.0 Request processed in 38us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947053.267318:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790947053.267330:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790947053.267335:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877943593954688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947053.267360:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877943593954688:12345-0@lo:400:kworker.0 Request processed in 25us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947053.267376:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790947053.267388:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790947053.267394:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877943593954560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947053.267422:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1877943593954560:12345-0@lo:400:kworker.0 Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947053.267428:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1790947053.267443:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790947053.267447:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790947053.267450:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790947053.267452:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790947053.267481:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593953536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790947053.267513:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1877943593954560:0@lo:400:kworker.0 00000100:00100000:1.0:1790947053.267521:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f6d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593954176:0@lo:400:kworker.0 00010000:00080000:1.0:1790947053.267532:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7fbb800 x1877943593954688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947053.267540:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1877943593954688:0@lo:400:kworker.0 00000100:00100000:2.0:1790947053.267710:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593953408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790947053.267724:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593953280:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790947053.326065:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790947053.432494:0:20762:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790947053.456497:0:20762:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790947053.456561:0:20762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.456576:0:20762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.456583:0:20762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.456590:0:20762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.456616:0:20762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790947053.456622:0:20762:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790947053.456646:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790947053.456651:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790947053.456657:0:20762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790947053.456680:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790947053.456956:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877943593954816:0@lo:39:umount.0 00000100:00100000:1.0:1790947053.457085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947053.457185:0:17190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954816 00000100:00100000:2.0:1790947053.457194:0:17190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954816 00000100:00100000:2.0:1790947053.457250:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790947053.457263:0:17190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877943593954816:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790947053.457298:0:17190:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de311 00000100:00080000:2.0:1790947053.457305:0:17190:0:(import.c:65:import_set_state_nolock()) ffff94b0c7120800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790947053.457383:0:17190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1877943593954816:12345-0@lo:39:umount.0 Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947053.457391:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1790947053.457399:0:17190:0:(genops.c:885:class_export_put()) final put ffff94b0c7124800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790947053.457422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7124800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790947053.457478:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c7120800 for lustre-MDT0000 00000100:00080000:2.0:1790947053.457511:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790947053.457521:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877943593954816:0@lo:39:umount.0 00010000:00010000:1.0:1790947053.457640:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947053.457648:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947053.457657:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c0030000 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:1.0:1790947053.457662:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947053.457688:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790947053.457695:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947053.457701:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790947053.457703:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790947053.457706:0:17178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790947053.457744:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947053.457752:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790947053.457780:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947053.457788:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c0030000/0xe6f6b79c2d6de2e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de2e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947053.457800:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947053.457802:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947053.457814:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947053.457822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790947053.457833:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3640:1877943593954944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790947053.457895:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947053.457930:0:17176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593954944 00000100:00100000:1.0:1790947053.457934:0:17176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593954944 00000100:00100000:1.0:1790947053.457966:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947053.457973:0:17176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38422016-28cf-4c0a-9d3b-4ac65d884a5a+24:3640:x1877943593954944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947053.457990:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947053.458004:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c0031400/0xe6f6b79c2d6de2e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de2e0 expref: 24 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947053.458016:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790947053.458054:0:17176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38422016-28cf-4c0a-9d3b-4ac65d884a5a+23:3640:x1877943593954944:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947053.458061:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947053.458088:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3640:1877943593954944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947053.458659:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790947053.459427:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790947053.459433:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790947053.459439:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790947053.460336:0:20762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460350:0:20762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460375:0:20762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460381:0:20762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460405:0:20762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790947053.460412:0:20762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460420:0:20762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460427:0:20762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460434:0:20762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.460444:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947053.460453:0:20762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790947053.460461:0:20762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460468:0:20762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460474:0:20762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.460491:0:20762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462657:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462674:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223400 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:2.0:1790947053.462679:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462709:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790947053.462716:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947053.462722:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790947053.462725:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790947053.462765:0:19582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462772:0:19582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790947053.462807:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462814:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1ef223400/0xe6f6b79c2d6de231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de238 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462831:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790947053.462835:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462841:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646ac00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:2.0:1790947053.462844:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462851:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790947053.462873:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947053.462885:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790947053.462887:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1790947053.462890:0:19582:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790947053.462908:0:19582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462914:0:19582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790947053.462931:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462937:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646ac00/0xe6f6b79c2d6de70f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de716 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462946:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947053.462949:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462954:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a000 already unused, calling callback (ffffffffc13f7c20) 00000100:00100000:0.0:1790947053.462955:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3640:1877943593955072:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1790947053.462957:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462963:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790947053.462969:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947053.462974:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790947053.462975:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790947053.462992:0:19582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.462997:0:19582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790947053.463019:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790947053.463022:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947053.463030:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947053.463032:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947053.463097:0:17174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955072 00000100:00100000:0.0:1790947053.463106:0:17174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955072 00000100:00100000:0.0:1790947053.463152:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790947053.463161:0:17174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38422016-28cf-4c0a-9d3b-4ac65d884a5a+23:3640:x1877943593955072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947053.463173:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947053.463186:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6de238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de231 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.463204:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947053.463254:0:17174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38422016-28cf-4c0a-9d3b-4ac65d884a5a+22:3640:x1877943593955072:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.463261:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790947053.463313:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3640:1877943593955072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947053.463355:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593955200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947053.463379:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.463397:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790947053.463402:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593955328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947053.463422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947053.463447:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955200 00000100:00100000:0.0:1790947053.463451:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955200 00000100:00100000:0.0:1790947053.463473:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955328 00000100:00100000:0.0:1790947053.463476:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955328 00000100:00100000:0.0:1790947053.463489:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790947053.463495:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+23:3641:x1877943593955200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947053.463502:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947053.463511:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7600000/0xe6f6b79c2d6de716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de70f expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.463522:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947053.463548:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+22:3641:x1877943593955200:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.463554:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790947053.463566:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790947053.463572:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1ef8dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+21:3641:x1877943593955328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947053.463585:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947053.463594:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6de7ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de7e8 expref: 21 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.463602:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947053.463623:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1ef8dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+20:3641:x1877943593955328:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947053.463629:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790947053.463689:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593955328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947053.463698:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593955200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790947053.463799:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947053.465426:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947053.469440:0:20762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790947053.469456:0:20762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6de7e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de7ef expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947053.469477:0:20762:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790947053.470149:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947053.470169:0:20762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.470181:0:20762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.470189:0:20762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.470196:0:20762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.470221:0:20762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790947053.470226:0:20762:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790947053.470231:0:20762:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790947053.470281:0:20762:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790947053.470286:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790947053.470303:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947053.470310:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1790947053.470317:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94b0c1610000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947053.470323:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94b1fe399000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947053.470328:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94b0c7125800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947053.470332:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94b1fe378000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947053.470339:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff94b0c8691800 9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 192.168.203.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1790947053.470344:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff94b1eee2a800 ff09b243-35ce-4289-aa72-8fb80b1be0db 192.168.203.29@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1790947053.470348:0:20762:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff94b1f6c83380) has exports, disconnecting them 00000020:00080000:0.0:1790947053.470351:0:20762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94b0c1610000), last request at 1790947053 00000020:00000080:0.0:1790947053.470359:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de548 00000100:00080000:0.0:1790947053.470376:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b0c1612000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790947053.470416:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947053.470424:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.470433:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222a00 already unused, calling callback (ffffffffc13f7c20) 00000020:00080000:0.0:1790947053.470436:0:20762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c1610000): rc 0 10000000:00010000:3.0:1790947053.470439:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1790947053.470441:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c1610000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1790947053.470452:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790947053.470457:0:20762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94b1fe399000), last request at 1790947053 00000020:00000080:0.0:1790947053.470464:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de4bc 10000000:00010000:3.0:1790947053.470465:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790947053.470469:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37d800 : changing import state from FULL to CLOSED 10000000:01000000:3.0:1790947053.470475:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790947053.470478:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790947053.470481:0:17178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790947053.470485:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790947053.470494:0:20762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b1fe399000): rc 0 00000020:00000080:0.0:1790947053.470496:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe399000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1790947053.470500:0:20762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94b0c7125800), last request at 1790946981 00000020:00000080:0.0:1790947053.470503:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de3ff 00000100:00080000:0.0:1790947053.470507:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b0c7125000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790947053.470517:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.470519:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947053.470525:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1790947053.470527:0:20762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c7125800): rc 0 00000020:00000080:0.0:1790947053.470530:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c7125800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1790947053.470547:0:20762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94b1fe378000), last request at 1790946981 00000020:00000080:0.0:1790947053.470551:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de396 00000100:00080000:0.0:1790947053.470557:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37a800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790947053.470558:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.470566:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1ef222a00/0xe6f6b79c2d6de223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de22a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947053.470570:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790947053.470578:0:20762:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:3.0:1790947053.470591:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593955456:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1790947053.470650:0:20762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b1fe378000): rc 0 00000100:00100000:3.0:1790947053.470656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:0.0:1790947053.470657:0:20762:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf9080d7fae0 00000100:00080000:0.0:1790947053.470675:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790947053.470680:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1790947053.470729:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955456 00000100:00100000:3.0:1790947053.470737:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955456 00000100:00100000:3.0:1790947053.470778:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947053.470785:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+20:3639:x1877943593955456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790947053.470797:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947053.470810:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6de22a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de223 expref: 20 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947053.470821:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947053.470852:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38422016-28cf-4c0a-9d3b-4ac65d884a5a+19:3639:x1877943593955456:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947053.470875:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947053.470908:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593955456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790947053.470924:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947053.470941:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947053.470942:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790947053.471192:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c1610000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790947053.471231:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe399000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790947053.471252:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7125800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790947053.471337:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c1612000 for lustre-MDT0000 00000020:00000080:2.0:1790947053.471342:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fe37d800 for lustre-MDT0000 00000020:00000080:2.0:1790947053.471345:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c7125000 for lustre-MDT0000 00010000:00010000:2.0:1790947053.471354:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790947053.475375:0:20762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790947053.475411:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b0c76e1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790947053.475584:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593955584:0@lo:39:umount.0 00000100:00100000:2.0:1790947053.475655:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790947053.475899:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790947053.475904:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1790947053.475923:0:20762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790947053.475983:0:20762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790947053.475995:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b1c5560800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790947053.476003:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790947053.476005:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1790947053.476015:0:20762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790947053.476086:0:20762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790947053.476094:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b1ed188800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790947053.476135:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94b1f6c83380) has no exports 00000100:00100000:2.0:1790947053.476955:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593955712:0@lo:9:umount.0 00000100:00100000:2.0:1790947053.476998:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947053.477026:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593955840:0@lo:9:umount.0 00000100:00100000:2.0:1790947053.477059:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947053.477101:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955712 00000100:00100000:2.0:1790947053.477108:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955712 00000100:00100000:2.0:1790947053.477147:0:18698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955840 00000100:00100000:2.0:1790947053.477150:0:18698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955840 00000100:00100000:2.0:1790947053.477172:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790947053.477181:0:18698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877943593955712:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790947053.477220:0:18698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de56b 00000100:00080000:2.0:1790947053.477229:0:18698:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790947053.477286:0:18698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790947053.477409:0:18698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3638:x1877943593955712:12345-0@lo:9:umount.0 Request processed in 227us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947053.477417:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790947053.477428:0:19587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790947053.477443:0:19587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877943593955840:12345-0@lo:9:umount.0 00010000:00010000:2.0:1790947053.477453:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790947053.477460:0:19587:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de572 00000100:00080000:3.0:1790947053.477468:0:19587:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c7000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1790947053.477482:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1c5560800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790947053.477495:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790947053.477497:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790947053.477500:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593955712:0@lo:9:umount.0 00000001:00000004:3.0:1790947053.477508:0:19587:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790947053.477618:0:19587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3638:x1877943593955840:12345-0@lo:9:umount.0 Request processed in 179us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947053.477625:0:19587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1790947053.477643:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947053.479179:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1ed188800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790947053.479205:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790947053.479208:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790947053.479213:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593955840:0@lo:9:umount.0 00000100:00100000:0.0:1790947053.479966:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955584 00000100:00100000:0.0:1790947053.479975:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955584 00000100:00100000:0.0:1790947053.480032:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790947053.480050:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877943593955584:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790947053.480079:0:17194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de429 00000100:00080000:0.0:1790947053.480087:0:17194:0:(import.c:65:import_set_state_nolock()) ffff94b1c31d8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790947053.480113:0:17194:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1790947053.480139:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947053.480288:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3638:x1877943593955584:12345-0@lo:39:umount.0 Request processed in 247us (4632us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790947053.480296:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1790947053.480409:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c76e1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790947053.480416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593955584:0@lo:39:umount.0 00000020:00080000:1.0:1790947053.496391:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94b1f6c83380) has no exports 00000020:00000080:1.0:1790947053.569170:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de27e 00000020:00000080:1.0:1790947053.569296:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c7704800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790947053.569317:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790947053.569489:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947053.569497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7704800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790947053.569502:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790947053.569509:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff94b1c69a99c0) has no exports 00000020:00000080:0.0:1790947053.570542:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de277 00000020:00000080:0.0:1790947053.570550:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe2ff000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790947053.570616:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe2ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790947053.571170:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947053.571302:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790947053.571307:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe172000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790947053.571321:0:20762:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe172000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790947053.571331:0:20762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000040:00080000:1.0:1790947053.902530:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790947054.349995:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790947054.799821:0:18692:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790947054.799830:0:18692:0:(genops.c:885:class_export_put()) final put ffff94b0c15c2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790947054.800287:0:18692:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ff09b243-35ce-4289-aa72-8fb80b1be0db 00000020:00000080:1.0:1790947054.800291:0:18692:0:(genops.c:885:class_export_put()) final put ffff94b1fcd1f000/ff09b243-35ce-4289-aa72-8fb80b1be0db 00000001:00100000:0.0:1790947054.803630:0:17169:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790947054.803639:0:17169:0:(genops.c:885:class_export_put()) final put ffff94b1fe378000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790947054.806313:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c15c2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790947054.807530:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c15c0800 for lustre-OST0000 00000001:00100000:0.0:1790947054.808536:0:17169:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000001:00080000:0.0:1790947054.808547:0:17169:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1790947054.808551:0:17169:0:(genops.c:885:class_export_put()) final put ffff94b0c8691800/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000001:00100000:0.0:1790947054.808558:0:17169:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ff09b243-35ce-4289-aa72-8fb80b1be0db 00000001:00080000:0.0:1790947054.808562:0:17169:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1790947054.808567:0:17169:0:(genops.c:885:class_export_put()) final put ffff94b1eee2a800/ff09b243-35ce-4289-aa72-8fb80b1be0db 00000020:00000080:3.0:1790947054.811490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fcd1f000/ff09b243-35ce-4289-aa72-8fb80b1be0db for lustre-OST0000 00000001:00100000:0.0:1790947054.811582:0:17922:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790947054.811594:0:17922:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1790947054.811599:0:17922:0:(genops.c:885:class_export_put()) final put ffff94b1c31da000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790947054.820510:0:17922:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000001:00080000:0.0:1790947054.820525:0:17922:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1790947054.820530:0:17922:0:(genops.c:885:class_export_put()) final put ffff94b0c67da000/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 00000001:00100000:0.0:1790947054.820539:0:17922:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ff09b243-35ce-4289-aa72-8fb80b1be0db 00000001:00080000:0.0:1790947054.820545:0:17922:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1790947054.820547:0:17922:0:(genops.c:885:class_export_put()) final put ffff94b0c15c5000/ff09b243-35ce-4289-aa72-8fb80b1be0db 00000020:00000080:3.0:1790947054.820801:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe378000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1790947054.826595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c8691800/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 for lustre-MDT0000 00000020:00000080:3.0:1790947054.826669:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1eee2a800/ff09b243-35ce-4289-aa72-8fb80b1be0db for lustre-MDT0000 00000020:00000080:3.0:1790947054.826706:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fcd1b000 for lustre-OST0000 00000020:00000080:3.0:1790947054.826711:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c31da000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1790947054.826945:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c67da000/9445b1e2-fbe4-42e5-bb9e-1cc0fed3a7a3 for lustre-MDT0001 00000020:00000080:3.0:1790947054.826982:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c15c5000/ff09b243-35ce-4289-aa72-8fb80b1be0db for lustre-MDT0001 00000020:00000080:3.0:1790947054.827271:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fe37a800 for lustre-MDT0000 00000020:00000080:3.0:1790947054.827277:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c8696800 for lustre-MDT0000 00000020:00000080:3.0:1790947054.827281:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c15c6000 for lustre-MDT0000 00000020:00000080:3.0:1790947054.827283:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1c31d8000 for lustre-MDT0001 00000020:00000080:3.0:1790947054.827286:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c67d8000 for lustre-MDT0001 00000020:00000080:3.0:1790947054.827291:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fcd1f800 for lustre-MDT0001 00010000:00010000:3.0:1790947055.374127:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790947055.630077:0:20762:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1d8ed4d80 - data ffff94b0c5c9f510/ffff94b0c1b47800 00000020:01000000:1.0:1790947055.630266:0:20762:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b0c16c7d80 - data ffff94b1ef636e58/ffff94b1c6c89000 00000001:00000004:1.0:1790947055.636565:0:20762:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1790947055.686466:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790947055.686475:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790947055.686489:0:20762:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff94b1c2eb0000 x1877943593955584/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790947063 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947055.686514:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790947055.693146:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790947055.693155:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1790947055.693173:0:20762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790947055.693190:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790947055.695240:0:17213:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790947055.695248:0:17213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1790947055.695263:0:17213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1790947055.696114:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790947055.696120:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1790947055.696130:0:20762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790947055.696132:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790947055.698012:0:17215:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790947055.698018:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1790947055.698042:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1790947055.718536:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de246 00000020:00000080:0.0:1790947055.718560:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe2fe000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790947055.718647:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe2fe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790947055.721168:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de25b 00000020:00000080:0.0:1790947055.721182:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe170000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790947055.721202:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790947055.721208:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947055.721217:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790947055.721222:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff94b1f6c84d40) has no exports 00000020:00000080:2.0:1790947055.721396:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe170000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1790947055.721477:0:20762:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790947055.721486:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de2bd 00000020:00000080:0.0:1790947055.721490:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1ef9bf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790947055.721506:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790947055.721511:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947055.721516:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790947055.721519:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff94b1c640cd40) has no exports 00000020:00000080:0.0:1790947055.721526:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de2b6 00000020:00000080:0.0:1790947055.721529:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1ed18a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790947055.721800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1ef9bf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790947055.721808:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1ed18a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790947055.722126:0:20762:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790947055.722130:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790947055.722134:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1790947055.722139:0:20762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790947055.722141:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790947055.722170:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947055.722175:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790947055.722182:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de2a8 00000020:00000080:0.0:1790947055.722186:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1c5567800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790947055.722189:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790947055.722192:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947055.722205:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790947055.722208:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff94b0c7103380) has no exports 00000020:00000080:0.0:1790947055.722212:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de2a1 00000020:00000080:0.0:1790947055.722215:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1c5565000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790947055.722311:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1ed188800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790947055.722324:0:36:0:(genops.c:885:class_export_put()) final put ffff94b1c5566000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790947055.722326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c5566000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790947055.722331:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790947055.722404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c5567800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790947055.722409:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c5565000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790947055.723631:0:20762:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790947055.723637:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790947055.723641:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1790947055.723647:0:20762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790947055.723648:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790947055.723693:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947055.723701:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790947055.723708:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1c5560800 for lustre-OST0000-osc-MDT0000 00000004:01000000:0.0:1790947055.723715:0:20762:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790947055.723718:0:36:0:(genops.c:885:class_export_put()) final put ffff94b1c5567000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790947055.723723:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c5567000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790947055.723724:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de293 00000020:01000000:2.0:1790947055.723730:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790947055.723881:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1c5563000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790947055.723893:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790947055.723898:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947055.723902:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790947055.723905:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff94b1c69acd40) has no exports 00000020:00000080:3.0:1790947055.723910:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c5563000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1790947055.723911:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de28c 00000020:00000080:0.0:1790947055.723916:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c76e5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790947055.723932:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c76e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790947055.725068:0:20762:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1790947055.725074:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790947055.725077:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790947055.725082:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790947055.725124:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947055.725131:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790947055.725153:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947055.725157:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790947055.725161:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe2fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790947055.725165:0:20762:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe2fa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790947055.725170:0:20762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790947055.725247:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de262 00000020:00000080:2.0:1790947055.725252:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe175000/lustre-MDD0000_UUID 00000020:01000000:2.0:1790947055.725257:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790947055.725261:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947055.725265:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790947055.725267:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff94b1f6c80000) has no exports 00000020:00000080:2.0:1790947055.725284:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947055.725286:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1790947055.725289:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de269 00000020:00000080:2.0:1790947055.725301:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe177800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790947055.725309:0:20762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b0c7f65800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1790947055.725312:0:20762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b0c7f65800 3 00000020:01000004:2.0:1790947055.725315:0:20762:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94b0c7f65800 from lustre-MDT0000 00000020:00000080:2.0:1790947055.725329:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947055.725333:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1790947055.725335:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe2f9800/lustre-MDT0000_UUID 00000020:00000080:2.0:1790947055.725337:0:20762:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe2f9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1790947055.725343:0:20762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1790947055.725372:0:20762:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1790947055.725376:0:20762:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1790947055.725378:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1790947055.725382:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947055.725384:0:20762:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790947055.725391:0:20762:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff94b2003ab800 38422016-28cf-4c0a-9d3b-4ac65d884a5a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790947055.725396:0:20762:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff94b1c6408000) has exports, disconnecting them 00000020:00080000:2.0:1790947055.725400:0:20762:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94b2003ab800), last request at 1790946967 00000020:00000080:2.0:1790947055.725413:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de20e 00000020:00010000:2.0:1790947055.725417:0:20762:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94b2003ab800: total 2 00000100:00080000:2.0:1790947055.725420:0:20762:0:(import.c:65:import_set_state_nolock()) ffff94b2003a9800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790947055.725433:0:20762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b2003ab800): rc 0 00000020:00080000:2.0:1790947055.725436:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff94b1c6408000) has no exports 00000020:00000080:0.0:1790947055.725749:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c76e1800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1790947055.725757:0:8:0:(genops.c:885:class_export_put()) final put ffff94b0c7703000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790947055.725760:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7703000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1790947055.725765:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790947055.725820:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe175000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790947055.725824:0:8:0:(genops.c:885:class_export_put()) final put ffff94b1fe2fc000/lustre-MDD0000_UUID 00000020:00000080:0.0:1790947055.725825:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe2fc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790947055.725829:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790947055.725902:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe177800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1790947055.725933:0:17184:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff94b1fe3bd200:17184] 2 exiting: rc = 0 00000100:00100000:0.0:1790947055.726061:0:17182:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff94b1efbf1400:17182] 0 exiting: rc = 1 00000020:00010000:0.0:1790947055.726118:0:19582:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94b2003ab800: total 0 00010000:00010000:0.0:1790947055.726122:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947055.726144:0:19582:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94b2003ab800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790947055.726173:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7601200/0xe6f6b79c2d6de708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de701 expref: 14 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726193:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c0030400/0xe6f6b79c2d6de32d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de326 expref: 13 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726207:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6de499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de492 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726218:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ecb46200/0xe6f6b79c2d6de7c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de7be expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726227:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c0030c00/0xe6f6b79c2d6de3ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de3e3 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726236:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223800/0xe6f6b79c2d6de33b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de334 expref: 9 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726248:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c646aa00/0xe6f6b79c2d6de7d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de7cc expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726258:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c0031200/0xe6f6b79c2d6de349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de342 expref: 7 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726268:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c0030a00/0xe6f6b79c2d6de21c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de215 expref: 6 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726279:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c28a00/0xe6f6b79c2d6de509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de502 expref: 5 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726298:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7601e00/0xe6f6b79c2d6de533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de52c expref: 4 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726309:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7601000/0xe6f6b79c2d6de7e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de7da expref: 3 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726322:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c28000/0xe6f6b79c2d6de46f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6f6b79c2d6de468 expref: 2 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947055.726333:0:19582:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94b2003ab800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1790947055.726345:0:19582:0:(genops.c:885:class_export_put()) final put ffff94b2003ab800/38422016-28cf-4c0a-9d3b-4ac65d884a5a 00010000:00010000:0.0:1790947055.726356:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947055.726358:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947055.726360:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790947055.726366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b2003ab800/38422016-28cf-4c0a-9d3b-4ac65d884a5a for MGS 00000020:00000080:0.0:1790947055.726392:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b2003a9800 for MGS 00000100:00100000:0.0:1790947055.726426:0:17183:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff94b1efbf1e00:17183] 1 exiting: rc = 0 00000100:00100000:2.0:1790947055.728300:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728311:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728316:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728322:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728328:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728334:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728340:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728346:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728353:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728358:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728382:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728388:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728394:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728400:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728406:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728411:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728427:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728434:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728439:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728445:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728450:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728457:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728462:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728468:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728473:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728479:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728485:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728490:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728496:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728503:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728509:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728514:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728520:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728527:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728532:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728538:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728543:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728549:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728555:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728561:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728566:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728573:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728578:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728584:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728589:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728603:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728609:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728615:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728620:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728626:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728631:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728636:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728641:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728646:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728652:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728657:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728662:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728668:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728673:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728679:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728683:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728689:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728695:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947055.728700:0:20762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1790947055.730432:0:20762:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1f6f066c0 - data ffff94b1ef661360/ffff94b1e79bd400 00000020:01000000:2.0:1790947055.730563:0:20762:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1f6f06420 - data ffff94b1ef682bd0/ffff94b1c2dce000 00000020:00000080:2.0:1790947055.731039:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de1f2 00000020:00000080:2.0:1790947055.731047:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c774f000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790947055.731061:0:20762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b0c7f65800 from MGS, refs=2 00000020:01000004:2.0:1790947055.731065:0:20762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b0c7f65800 2 00000020:01000004:2.0:1790947055.731068:0:20762:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94b0c7f65800 from MGS 00000020:00000080:2.0:1790947055.731090:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947055.731098:0:20762:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790947055.731101:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c7748800/MGS 00000020:00000080:2.0:1790947055.731104:0:20762:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7748800/MGS for MGS 00000020:01000000:2.0:1790947055.731111:0:20762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790947055.731177:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790947055.731182:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947055.731188:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790947055.731205:0:20762:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94b0c7734000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790947055.731212:0:20762:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff94b0c71019c0) has exports, disconnecting them 00000020:00080000:2.0:1790947055.731216:0:20762:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94b0c7734000), last request at 1790946967 00000020:00000080:2.0:1790947055.731220:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de2f5 00000020:00080000:2.0:1790947055.731231:0:20762:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c7734000): rc 0 00000020:00000080:2.0:1790947055.731235:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c7734000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790947055.731933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c774f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790947055.731943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7734000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790947055.747128:0:20762:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790947055.747136:0:20762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947055.747141:0:20762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790947055.747148:0:20762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790947055.747178:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fe37d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790947055.747351:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947055.747359:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1790947055.747364:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b1fe37e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790947055.747368:0:20762:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe37e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1790947055.747391:0:20762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790947055.747483:0:20762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b0c7f65800 1 00000020:00000080:0.0:1790947055.747489:0:20762:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de1e4 00000020:00000080:0.0:1790947055.747496:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c774a800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790947055.747505:0:20762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790947055.747514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c774a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790947055.747523:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947055.747527:0:20762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790947055.747531:0:20762:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff94b0c7104d40) has no exports 00000020:00000080:1.0:1790947055.899169:0:20762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947055.899183:0:20762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790947055.899189:0:20762:0:(genops.c:885:class_export_put()) final put ffff94b0c7f67000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790947055.899193:0:20762:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7f67000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790947055.899206:0:20762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790947055.899334:0:20762:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94b0c7f62800 00000020:02000400:1.0:1790947055.899392:0:20762:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790947056.402151:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947057.423076:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947057.870152:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593955968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790947057.870296:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947057.870852:0:17930:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593955968 00000100:00100000:1.0:1790947057.870889:0:17930:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593955968 00000100:00100000:1.0:1790947057.870935:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790947057.870943:0:17930:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1877943593955968:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1790947057.870952:0:17930:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790947057.871021:0:17930:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1877943593955968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (724us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790947057.871027:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:02020000:3.0:1790947057.871105:0:3640:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1790947057.882663:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790947057.882673:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94b1f56e0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790947057.882679:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790947057.902294:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94b1f56e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947057.902310:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1790947057.902327:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94b1f56e0000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947057.902529:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7d3ca80 x1877943593956096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947057.903077:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593956096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1790947057.903144:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947057.903836:0:17195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956096 00000100:00100000:2.0:1790947057.903845:0:17195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956096 00000100:00100000:2.0:1790947057.904048:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790947057.904057:0:17195:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593956096:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1790947057.904082:0:17195:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790947057.925021:0:17195:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593956096:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 20945us (21856us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790947057.925036:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1790947057.925330:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f56e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947057.925337:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790947057.925342:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593956096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1790947058.393977:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593956224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790947058.394085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947058.394148:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790947058.394156:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593956352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790947058.394182:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790947058.394342:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790947058.394348:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790947058.394351:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b1f56e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790947058.394357:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:0.0:1790947058.394362:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790947058.394371:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94b1f56e0000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947058.395601:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb2d80 x1877943593956608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790947058.396935:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593956608:0@lo:38:kworker.0 00000100:00100000:1.0:1790947058.396998:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947058.397057:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593956480:0@lo:400:kworker.0 00000400:00000100:1.0:1790947058.397077:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877943593956480 offset 0 length 224: 4 00000100:00100000:1.0:1790947058.397098:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1877943593957120:0@lo:400:kworker.0 00000100:00100000:1.0:1790947058.397148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947058.397180:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790947058.397185:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943593956736:0@lo:400:kworker.0 00000100:00100000:1.0:1790947058.397204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947058.397217:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1877943593957248:0@lo:400:kworker.0 00000100:00100000:1.0:1790947058.397233:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947058.397270:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956224 00000100:00100000:1.0:1790947058.397277:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956224 00000100:00100000:1.0:1790947058.397321:0:18700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956352 00000100:00100000:1.0:1790947058.397324:0:18700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956352 00000100:00100000:1.0:1790947058.397339:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790947058.397346:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593956224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790947058.397376:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790947058.397412:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593956224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (3327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947058.397418:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790947058.397432:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790947058.397437:0:18700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593956352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790947058.397450:0:18700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790947058.397468:0:18700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593956352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947058.397474:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790947058.397505:0:17194:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956608 00000100:00100000:1.0:1790947058.397509:0:17194:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956608 00000100:00100000:1.0:1790947058.397528:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790947058.397597:0:17194:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1877943593956608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790947058.397616:0:17194:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790947058.397648:0:17194:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1877943593956608:12345-0@lo:38:kworker.0 Request processed in 52us (649us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790947058.397659:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790947058.397674:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957120 00000100:00100000:1.0:1790947058.397677:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957120 00000100:00100000:1.0:1790947058.397706:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956736 00000100:00100000:1.0:1790947058.397708:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956736 00000100:00100000:1.0:1790947058.397786:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957248 00000100:00100000:1.0:1790947058.397790:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957248 00000100:00100000:1.0:1790947058.397806:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790947058.397811:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877943593957248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947058.397844:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877943593957248:12345-0@lo:400:kworker.0 Request processed in 32us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947058.397850:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790947058.397881:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790947058.397884:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877943593957120:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790947058.397889:0:17191:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790947058.397908:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877943593957120:12345-0@lo:400:kworker.0 Request processed in 23us (760us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790947058.397913:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790947058.397922:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790947058.397925:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877943593956736:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790947058.397929:0:17191:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790947058.397944:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877943593956736:12345-0@lo:400:kworker.0 Request processed in 17us (739us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790947058.397949:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790947058.397980:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790947058.397984:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790947058.397986:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790947058.398028:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f56e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790947058.398039:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790947058.398043:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593956608:0@lo:38:kworker.0 00000100:00080000:1.0:1790947058.398070:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790947058.398074:0:3639:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790947058.398078:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790947058.398083:0:3639:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790947058.398089:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1790947058.398097:0:3639:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94b1fe37b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947058.398121:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7d3ed80 x1877943593957376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790947058.398140:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943593956736:0@lo:400:kworker.0 00010000:00080000:1.0:1790947058.398151:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff94b0c7e76a00 x1877943593957248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947058.398162:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1877943593957248:0@lo:400:kworker.0 00000100:00080000:1.0:1790947058.398170:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790947058.398173:0:3639:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790947058.398176:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790947058.398178:0:3639:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790947058.398181:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 507 00000100:00080000:1.0:1790947058.398184:0:3639:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94b0c15c4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947058.398193:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7d3fb80 x1877943593957504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790947058.398213:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1877943593957120:0@lo:400:kworker.0 00000100:00100000:1.0:1790947058.398232:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877943593957376:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790947058.398256:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947058.398270:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593957504:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790947058.398284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947058.398302:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957376 00000100:00100000:1.0:1790947058.398305:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957376 00000100:00100000:1.0:1790947058.398318:0:18466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957504 00000100:00100000:1.0:1790947058.398320:0:18466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957504 00000100:00100000:1.0:1790947058.398329:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790947058.398333:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1877943593957376:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1790947058.398344:0:18466:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790947058.398367:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1877943593957376:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (111us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790947058.398373:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790947058.398382:0:18466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790947058.398385:0:18466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1877943593957504:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1790947058.398393:0:18466:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790947058.398409:0:18466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1877943593957504:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 23us (124us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790947058.398414:0:18466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1790947058.398434:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790947058.398437:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790947058.398440:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877943593957376:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1790947058.398453:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790947058.398456:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790947058.398458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593957504:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1790947058.399492:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593956992:0@lo:400:kworker.0 00000100:00100000:0.0:1790947058.399626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947058.399695:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947058.399711:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593956864:0@lo:400:kworker.0 00000100:00100000:0.0:1790947058.399743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947058.399991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593956352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790947058.400027:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593956224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790947058.400081:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956992 00000100:00100000:1.0:1790947058.400088:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956992 00000100:00100000:1.0:1790947058.400171:0:17189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593956864 00000100:00100000:1.0:1790947058.400174:0:17189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593956864 00000100:00100000:1.0:1790947058.400190:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790947058.400199:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877943593956992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947058.400245:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877943593956992:12345-0@lo:400:kworker.0 Request processed in 47us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947058.400252:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790947058.400282:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790947058.400285:0:17189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877943593956864:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790947058.400290:0:17189:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790947058.400313:0:17189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1877943593956864:12345-0@lo:400:kworker.0 Request processed in 26us (570us total) trans 0 rc -107/-107 00000100:00080000:0.0:1790947058.400336:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790947058.400357:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790947058.400362:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790947058.400366:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790947058.400370:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790947058.400374:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 491 00000100:00080000:0.0:1790947058.400382:0:3642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94b0c7ea3800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947058.400405:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e77480 x1877943593957632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790947058.400425:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593956864:0@lo:400:kworker.0 00010000:00080000:0.0:1790947058.400437:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff94b0c7e74380 x1877943593956992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947058.400445:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593956992:0@lo:400:kworker.0 00000100:00100000:0.0:1790947058.400465:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1877943593957632:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790947058.400496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947058.400529:0:17191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957632 00000100:00100000:0.0:1790947058.400664:0:17191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957632 00000100:00100000:1.0:1790947058.407685:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790947058.413419:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790947058.413433:0:17191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877943593957632:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1790947058.413458:0:17191:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1790947058.413772:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790947058.413780:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790947058.413785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1877943593957632:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790947058.413823:0:17191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877943593957632:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 389us (13325us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790947058.413833:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1790947058.447995:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790947058.921197:0:19509:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790947058.921211:0:19509:0:(genops.c:885:class_export_put()) final put ffff94b0c15c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790947058.921306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c15c3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790947058.923681:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c15c7000 for lustre-OST0001 00010000:00010000:0.0:1790947059.471192:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790947060.032590:0:20963:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790947060.049222:0:20963:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1790947060.049284:0:20963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.049300:0:20963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.049307:0:20963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.049314:0:20963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.049341:0:20963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790947060.049347:0:20963:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790947060.049370:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947060.049374:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790947060.049380:0:20963:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790947060.049385:0:20963:0:(import.c:65:import_set_state_nolock()) ffff94b1fe37b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790947060.049390:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947060.049406:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790947060.049409:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790947060.050337:0:20963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050351:0:20963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050359:0:20963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050366:0:20963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050387:0:20963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790947060.050403:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947060.050410:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050417:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600e00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947060.050421:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050430:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947060.050437:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947060.050443:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790947060.050445:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790947060.050458:0:19582:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790947060.050492:0:19582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050499:0:19582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947060.050519:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050525:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7600e00/0xe6f6b79c2d6de3e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de3ea expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050542:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947060.050545:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050551:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601a00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947060.050554:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050561:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947060.050567:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947060.050573:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790947060.050575:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1790947060.050585:0:19582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050590:0:19582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947060.050596:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050608:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7601a00/0xe6f6b79c2d6de342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de349 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050617:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.050619:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.050621:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947060.050639:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593957760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947060.050700:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947060.050743:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790947060.050750:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593957888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947060.050769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790947060.050795:0:20963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050804:0:20963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050811:0:20963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050817:0:20963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050830:0:20963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947060.050837:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947060.050842:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050886:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29800 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947060.050889:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050896:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947060.050903:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947060.050908:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790947060.050910:0:17177:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790947060.050912:0:17177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790947060.050925:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050932:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947060.050944:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050950:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29800/0xe6f6b79c2d6de701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de708 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050963:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.050964:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.050966:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.050975:0:20963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.050982:0:20963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051006:0:20963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051012:0:20963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051023:0:20963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947060.051031:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947060.051035:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051040:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c28c00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947060.051043:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051050:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947060.051056:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947060.051061:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790947060.051062:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790947060.051064:0:19582:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790947060.051078:0:19582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051084:0:19582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947060.051090:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051104:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6de7da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de7e1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051112:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.051113:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.051115:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.051124:0:20963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051132:0:20963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051138:0:20963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051144:0:20963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051156:0:20963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790947060.051159:0:20963:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1790947060.051162:0:20963:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1790947060.051187:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947060.051191:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051196:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600800 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947060.051199:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051216:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947060.051222:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947060.051227:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790947060.051229:0:17177:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790947060.051230:0:17177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790947060.051245:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051250:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947060.051261:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051267:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6de334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6f6b79c2d6de33b expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947060.051278:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.051280:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947060.051281:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947060.051286:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947060.051295:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3642:1877943593958272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947060.051320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1790947060.051357:0:20963:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1790947060.051361:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1790947060.051366:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947060.051371:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1790947060.051375:0:20963:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff94b0c8697800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947060.051386:0:20963:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff94b1c2fec800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947060.051391:0:20963:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff94b1ef90cd40) has exports, disconnecting them 00000020:00080000:0.0:1790947060.051395:0:20963:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff94b0c8697800), last request at 1790947058 00000020:00000080:0.0:1790947060.051401:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de55d 00000100:00080000:0.0:1790947060.051416:0:20963:0:(import.c:65:import_set_state_nolock()) ffff94b0c8697000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790947060.051449:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790947060.051460:0:20963:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c8697800): rc 0 00000020:00000080:0.0:1790947060.051462:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b0c8697800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1790947060.051474:0:20963:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff94b1c2fec800), last request at 1790947058 00000020:00000080:0.0:1790947060.051478:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de4c3 00000100:00080000:0.0:1790947060.051483:0:20963:0:(import.c:65:import_set_state_nolock()) ffff94b0c7114000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790947060.051491:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790947060.051497:0:20963:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b1c2fec800): rc 0 00000020:00000080:0.0:1790947060.051499:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1c2fec800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1790947060.051506:0:20963:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaf9081dffae0 00000100:00080000:0.0:1790947060.051523:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947060.051531:0:20963:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff94b0c7d3dc00 x1877943593955968/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790947073 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947060.051540:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1790947060.052130:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947060.052148:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593958016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790947060.052200:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947060.052228:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790947060.052233:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593958144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790947060.052254:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947060.052590:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957760 00000100:00100000:3.0:1790947060.052598:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957760 00000100:00100000:3.0:1790947060.052625:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593957888 00000100:00100000:3.0:1790947060.052628:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593957888 00000100:00100000:3.0:1790947060.052636:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593958272 00000100:00100000:3.0:1790947060.052638:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593958272 00000100:00100000:3.0:1790947060.052646:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593958016 00000100:00100000:3.0:1790947060.052648:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593958016 00000100:00100000:3.0:1790947060.052667:0:17175:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593958144 00000100:00100000:3.0:1790947060.052670:0:17175:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593958144 00000100:00100000:3.0:1790947060.052681:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947060.052688:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1877943593957760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790947060.052694:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790947060 with bad export cookie 16642691354399203854 00000020:00000080:1.0:1790947060.053051:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c8697800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1790947060.053112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c2fec800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1790947060.053137:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c8697000 for lustre-MDT0001 00000020:00000080:1.0:1790947060.053141:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c7114000 for lustre-MDT0001 00000100:00100000:2.0:1790947060.056324:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593955968:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1790947060.056757:0:20963:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790947060.056764:0:20963:0:(import.c:65:import_set_state_nolock()) ffff94b1f56e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790947060.060633:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790947060.060644:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1790947060.060667:0:20963:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790947060.060732:0:20963:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790947060.060763:0:20963:0:(import.c:65:import_set_state_nolock()) ffff94b1d8eba000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790947060.060785:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790947060.060806:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1790947060.060815:0:20963:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790947060.060904:0:20963:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790947060.060914:0:20963:0:(import.c:65:import_set_state_nolock()) ffff94b1ed18a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790947060.060955:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff94b1ef90cd40) has no exports 00000100:00100000:2.0:1790947060.061977:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593958400:0@lo:9:umount.0 00000100:00100000:2.0:1790947060.062073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947060.062126:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593958528:0@lo:9:umount.0 00000100:00100000:2.0:1790947060.062164:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947060.062221:0:18696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593958400 00000100:00100000:2.0:1790947060.062229:0:18696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593958400 00000100:00100000:2.0:1790947060.062281:0:18696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593958528 00000100:00100000:2.0:1790947060.062285:0:18696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593958528 00000100:00100000:2.0:1790947060.062309:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790947060.062318:0:18696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877943593958400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790947060.062344:0:18696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de4ed 00000100:00080000:2.0:1790947060.062353:0:18696:0:(import.c:65:import_set_state_nolock()) ffff94b1c5564800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790947060.062389:0:18696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790947060.062509:0:18696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1877943593958400:12345-0@lo:9:umount.0 Request processed in 192us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947060.062517:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790947060.062532:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790947060.062538:0:18696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877943593958528:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790947060.062548:0:18696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de579 00000100:00080000:2.0:1790947060.062553:0:18696:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790947060.062572:0:18696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790947060.062639:0:18696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1877943593958528:12345-0@lo:9:umount.0 Request processed in 101us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947060.062645:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1790947060.062661:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790947060.062664:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790947060.062677:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947060.062683:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947060.062707:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1d8eba000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790947060.062718:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790947060.062720:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790947060.062723:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593958400:0@lo:9:umount.0 00000100:00080000:2.0:1790947060.062743:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1ed18a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790947060.062751:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790947060.062753:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790947060.062756:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593958528:0@lo:9:umount.0 00000100:00100000:2.0:1790947060.072542:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1877943593957760:12345-0@lo:103:ldlm_bl.0 Request processed in 19846us (21835us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790947060.072557:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790947060.072594:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790947060.072600:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1877943593957888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790947060.072606:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790947060 with bad export cookie 16642691354399203854 00000100:00100000:2.0:1790947060.072639:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1877943593957888:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (21868us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790947060.072644:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790947060.072656:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790947060.072660:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1877943593958272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790947060.072664:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790947060 with bad export cookie 16642691354399203854 00000100:00100000:2.0:1790947060.072705:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1877943593958272:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (21384us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790947060.072711:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790947060.072723:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790947060.072727:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1877943593958016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790947060.072731:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790947060 with bad export cookie 16642691354399203854 00000100:00100000:2.0:1790947060.072771:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1877943593958016:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (20571us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790947060.072778:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790947060.072790:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790947060.072813:0:17175:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1877943593958144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790947060.072818:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790947060 with bad export cookie 16642691354399203854 00000100:00100000:2.0:1790947060.072848:0:17175:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1877943593958144:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (20593us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790947060.072853:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790947060.072999:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790947060.073009:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from FULL to DISCONN 00000100:00080000:1.0:1790947060.073014:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:02020000:3.0:1790947060.073019:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1790947060.073075:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790947060.087620:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.129@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1790947060.087632:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790947060.087649:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b1c2eb1c00 x1877943593956480/t0(0) o400->MGC192.168.203.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790947074 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947060.087671:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e77b80 x1877943593957760/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790947076 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947060.087682:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e76680 x1877943593957888/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790947076 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947060.087691:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e75180 x1877943593958272/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790947076 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947060.087700:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e76d80 x1877943593958016/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790947076 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947060.087929:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e74000 x1877943593958144/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790947076 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790947060.087940:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790947060.087943:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790947060.087945:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790947060.091824:0:3639:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff94b2003aa800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1790947060.091892:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593958016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790947060.091905:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593956480:0@lo:400:kworker.0 00000100:00100000:1.0:1790947060.091944:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3639:1877943593958144:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1790947060.092429:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff94b2003aa800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790947060.092444:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593957760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947060.092458:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3641:1877943593957888:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790947060.098681:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947060.098770:0:3642:0:(import.c:545:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1790947060.098795:0:3642:0:(import.c:666:import_select_connection()) MGC192.168.203.129@tcp: import ffff94b2003aa800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947060.099007:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c82a00 x1877943593958656/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790947060.099063:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3642:1877943593958272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790947060.099107:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3638:1877943593958656:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1790947060.099193:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877943593958656 offset 0 length 520: 4 00000020:00080000:0.0:1790947060.104444:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff94b1ef90cd40) has no exports 00000020:01000000:2.0:1790947060.149643:0:20963:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1d8ed4ae0 - data ffff94b1ef4f40d8/ffff94b0c1b44800 00000020:01000000:2.0:1790947060.149806:0:20963:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b0c72766c0 - data ffff94b1c8c52798/ffff94b1e7a66800 00000001:00000004:2.0:1790947060.163001:0:20963:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1790947060.231241:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790947060.231251:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790947060.231258:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790947060.234088:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790947060.234096:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790947060.234111:0:20963:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790947060.234114:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790947060.237259:0:17931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790947060.237267:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1790947060.237300:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790947060.238014:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790947060.238022:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790947060.238041:0:20963:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790947060.238044:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790947060.238380:0:17933:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790947060.238384:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1790947060.238393:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1790947060.240340:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de357 00000020:00000080:3.0:1790947060.240351:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1f56e3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790947060.241017:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de36c 00000020:00000080:3.0:1790947060.241023:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1f56e5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790947060.241028:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1790947060.241033:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.241043:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790947060.241048:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff94b1ef908000) has no exports 00000004:01000000:3.0:1790947060.241267:0:20963:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790947060.241275:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de3c0 00000020:00000080:3.0:1790947060.241278:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1c56b9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790947060.241282:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790947060.241286:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.241290:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790947060.241292:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff94b0c73d3380) has no exports 00000020:00000080:3.0:1790947060.241307:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de3b9 00000020:00000080:3.0:1790947060.241310:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1ed18b800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1790947060.241606:0:20963:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790947060.241610:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790947060.241614:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1790947060.241620:0:20963:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790947060.241622:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790947060.241650:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.241657:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790947060.241668:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de3ab 00000020:00000080:3.0:1790947060.241673:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1c56bc800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790947060.241676:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790947060.241680:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.241683:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790947060.241686:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff94b1c640b380) has no exports 00000020:00000080:3.0:1790947060.241689:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de3a4 00000020:00000080:3.0:1790947060.241692:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1d8ebd000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1790947060.242036:0:20963:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790947060.242039:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790947060.242042:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1790947060.242045:0:20963:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790947060.242046:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790947060.242076:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.242081:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790947060.242199:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1f56e3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790947060.242208:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1f56e5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1790947060.242212:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c56b9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1790947060.242216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1ed18b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790947060.242221:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1ed18a000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1790947060.242226:0:37:0:(genops.c:885:class_export_put()) final put ffff94b1c56bf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790947060.242229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c56bf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1790947060.242233:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790947060.242310:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c56bc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790947060.242314:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1d8ebd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790947060.242318:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1d8eba000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790947060.242322:0:37:0:(genops.c:885:class_export_put()) final put ffff94b1ed189000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790947060.242324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1ed189000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1790947060.242328:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1790947060.242519:0:20963:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790947060.242525:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de38f 00000020:00000080:3.0:1790947060.242530:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1d8eb8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790947060.242546:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1790947060.242550:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.242555:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790947060.242558:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff94b1ef90b380) has no exports 00000020:00000080:3.0:1790947060.242562:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de388 00000020:00000080:3.0:1790947060.242572:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1d8eb9800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790947060.243010:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1d8eb8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1790947060.243018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1d8eb9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790947060.299672:0:20963:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1790947060.299680:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790947060.299685:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790947060.299693:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790947060.299777:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.299789:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790947060.299817:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.299820:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790947060.299825:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1c31d9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790947060.299829:0:20963:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c31d9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1790947060.299839:0:20963:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790947060.300015:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de373 00000020:00000080:3.0:1790947060.300022:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1f56e5000/lustre-MDD0001_UUID 00000020:00000080:1.0:1790947060.300055:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1f56e0000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1790947060.300061:0:37:0:(genops.c:885:class_export_put()) final put ffff94b1d8ebb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790947060.300063:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1d8ebb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1790947060.300079:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1790947060.300520:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1790947060.300525:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.300531:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790947060.300535:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff94b1ef9099c0) has no exports 00000020:00000080:3.0:1790947060.300557:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.300560:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1790947060.300564:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de37a 00000020:00000080:3.0:1790947060.300568:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1f56e2000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1790947060.300575:0:20963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b0c77aa800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1790947060.300579:0:20963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b0c77aa800 2 00000020:01000004:3.0:1790947060.300582:0:20963:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94b0c77aa800 from lustre-MDT0001 00000020:00000080:3.0:1790947060.300600:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.300602:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1790947060.300605:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b1f56e7800/lustre-MDT0001_UUID 00000020:00000080:3.0:1790947060.300607:0:20963:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1f56e7800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1790947060.300613:0:20963:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1790947060.300642:0:20963:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1790947060.300646:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1790947060.300654:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.300657:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790947060.300663:0:20963:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff94b0c7126000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790947060.300668:0:20963:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff94b0c73d4d40) has exports, disconnecting them 00000020:00080000:3.0:1790947060.300672:0:20963:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff94b0c7126000), last request at 1790946981 00000020:00000080:3.0:1790947060.300677:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de3f8 00000020:00080000:3.0:1790947060.300687:0:20963:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c7126000): rc 0 00000020:00000080:3.0:1790947060.300691:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b0c7126000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790947060.301693:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1f56e5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1790947060.301701:0:37:0:(genops.c:885:class_export_put()) final put ffff94b1f56e6000/lustre-MDD0001_UUID 00000020:00000080:1.0:1790947060.301703:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1f56e6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1790947060.301708:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1790947060.301845:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1f56e2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790947060.301850:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7126000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1790947060.342384:0:20963:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1790947060.342395:0:20963:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790947060.342400:0:20963:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790947060.342408:0:20963:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790947060.344785:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947060.344800:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1790947060.344809:0:20963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b0c77aa800 1 00000020:00000080:3.0:1790947060.344817:0:20963:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de31f 00000020:00000080:3.0:1790947060.344827:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b0c77ac800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1790947060.344836:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1790947060.344844:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947060.344848:0:20963:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790947060.344851:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff94b1c64099c0) has no exports 00000020:00000080:1.0:1790947060.345901:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1fe37b800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790947060.345915:0:37:0:(genops.c:885:class_export_put()) final put ffff94b1c31d9800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1790947060.345919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c31d9800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1790947060.345936:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1790947060.346033:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c77ac800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790947060.407323:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947060.407337:0:20963:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1790947060.407342:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b0c77ad800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790947060.407346:0:20963:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c77ad800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790947060.407351:0:20963:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1790947060.407469:0:20963:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94b0c77ac000 00000020:01000000:1.0:1790947060.407497:0:20963:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790947060.407502:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790947060.407506:0:20963:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790947060.407510:0:20963:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff94b1f6c819c0) has no exports 00000100:00100000:1.0:1790947060.407599:0:17190:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff94b1d88d2a00:17190] 1 exiting: rc = 0 00000100:00100000:0.0:1790947060.407650:0:19849:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff94b1e78fec00:19849] 4 exiting: rc = 0 00000100:00100000:0.0:1790947060.407757:0:17191:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff94b1fe25f000:17191] 2 exiting: rc = 0 00000100:00100000:3.0:1790947060.407846:0:17189:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff94b1fe25e800:17189] 0 exiting: rc = 1 00000100:00100000:1.0:1790947060.407928:0:18466:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff94b1c29c0600:18466] 3 exiting: rc = 0 00000100:00100000:3.0:1790947060.408021:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408030:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408038:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408045:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408052:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408059:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408068:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408076:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408084:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408104:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408113:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408121:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408129:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408140:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408150:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408159:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408166:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408172:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408177:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408182:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408190:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408195:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408207:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408229:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408304:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408313:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408335:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408343:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408350:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408361:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408369:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408378:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408386:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408394:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408403:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408410:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408419:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408429:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408439:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408449:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408455:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408460:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408465:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408474:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408488:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408494:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408499:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408505:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408510:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408516:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408522:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408549:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408557:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408565:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408574:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408582:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408590:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408598:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408606:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408613:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408620:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408627:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408635:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.408643:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.414771:0:17192:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff94b1c5236e00:17192] 0 exiting: rc = 1 00000100:00100000:1.0:1790947060.414937:0:17193:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff94b1c5236c00:17193] 1 exiting: rc = 0 00000100:00100000:3.0:1790947060.415841:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415851:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415873:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415879:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415888:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415894:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415900:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415905:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415910:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415917:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415924:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415929:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415935:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415943:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415948:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415968:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415975:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.415982:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416002:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416008:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416017:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416024:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416031:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416038:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416045:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416052:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416059:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416066:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416072:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416081:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416092:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416102:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416107:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416112:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416117:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416123:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416128:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416133:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416138:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416143:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416149:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416154:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416158:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416173:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416180:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416187:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416193:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416200:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416206:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416213:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416229:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416237:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416245:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416252:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416259:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416265:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416271:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416278:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416286:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416292:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416298:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416304:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.416311:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.420158:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.421419:0:17195:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff94b1c31e1a00:17195] 1 exiting: rc = 0 00000100:00100000:1.0:1790947060.421526:0:17930:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff94b1e7871400:17930] 2 exiting: rc = 0 00000100:00100000:3.0:1790947060.422038:0:17194:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff94b1c31e0600:17194] 0 exiting: rc = 1 00000100:00100000:0.0:1790947060.422155:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422167:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422176:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422184:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422200:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422208:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422215:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422221:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422227:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422232:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422238:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422244:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422250:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422257:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422262:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422268:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422290:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422309:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.422315:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423826:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423841:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423848:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423854:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423873:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423881:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423890:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423896:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423902:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423929:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423936:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423941:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423948:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423954:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423960:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423967:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423975:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423981:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.423997:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424004:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424011:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424031:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424038:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424043:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424049:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424056:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424062:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424067:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424074:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424080:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424086:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424092:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424098:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424132:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424139:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424146:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424152:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424158:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424164:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424170:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424176:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424184:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424192:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424197:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.424205:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.442982:0:17196:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff94b0c7c89200:17196] 0 exiting: rc = 1 00000100:00100000:0.0:1790947060.443193:0:17197:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff94b1fe346800:17197] 1 exiting: rc = 0 00000100:00100000:1.0:1790947060.443462:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443470:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443491:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443497:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443502:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443508:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443513:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443518:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443524:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443529:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443534:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443540:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443545:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443550:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443555:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443561:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443567:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443582:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443595:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443602:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443607:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443612:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443617:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443623:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443628:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443634:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443639:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443644:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443648:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443653:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443657:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443662:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443667:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443673:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443678:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443684:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443689:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443703:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443708:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443713:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443718:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443723:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443728:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443733:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443739:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443744:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443750:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443755:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443760:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443765:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443770:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443776:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443781:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443785:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443790:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443795:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443800:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443805:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443809:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443814:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443819:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443823:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443828:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.443833:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.445280:0:17198:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff94b1fd0aa800:17198] 0 exiting: rc = 1 00000100:00100000:2.0:1790947060.445293:0:17199:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff94b1fd0abe00:17199] 1 exiting: rc = 0 00000100:00100000:0.0:1790947060.445386:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445398:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445408:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445417:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445424:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445433:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445444:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445454:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445463:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445470:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445475:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445483:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445489:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445500:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445507:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445518:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445528:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445537:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445547:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445554:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445559:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445571:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445646:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445656:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445661:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445665:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445674:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445680:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445688:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445693:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445698:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445714:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445723:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445729:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445735:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445744:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445753:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445759:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445764:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445889:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445897:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445903:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445911:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445917:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445926:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445931:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445936:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445945:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445954:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445960:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445965:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445971:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445980:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445994:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.445999:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446005:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446009:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446028:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446037:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446042:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446048:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446053:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446058:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.446063:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947060.448313:0:17201:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff94b1fd0abc00:17201] 1 exiting: rc = 0 00000100:00100000:3.0:1790947060.448321:0:17200:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff94b1d0bbb400:17200] 0 exiting: rc = 1 00000100:00100000:0.0:1790947060.448437:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448447:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448454:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448460:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448465:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448475:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448483:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448488:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448494:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448499:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448504:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448509:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448514:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448521:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448527:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448535:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448542:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448551:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448556:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448561:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448566:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448571:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448577:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448582:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448586:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448592:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448598:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448604:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448625:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448630:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448635:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448641:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448646:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448651:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448657:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448662:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448667:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448673:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448679:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448687:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448693:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448771:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448779:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448786:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448796:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448806:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448812:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448817:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448823:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448828:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448834:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448839:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448844:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448850:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448855:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448981:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.448999:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449004:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449011:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449016:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449021:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449026:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449031:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790947060.449047:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947060.450516:0:17203:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff94b1c3734200:17203] 1 exiting: rc = 0 00000100:00100000:2.0:1790947060.451011:0:17202:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff94b0c7dadc00:17202] 0 exiting: rc = 1 00000100:00100000:2.0:1790947060.451219:0:17204:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff94b1c3735000:17204] 2 exiting: rc = 0 00000100:00100000:1.0:1790947060.452021:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452029:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452035:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452041:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452047:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452053:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452059:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452067:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452090:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452096:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452102:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452108:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452118:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452125:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452131:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452136:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452142:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452148:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452153:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452159:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452164:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452171:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452177:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452184:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452190:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452195:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452200:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452205:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452210:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452215:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452221:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452246:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452253:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452258:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452265:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452271:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452277:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452282:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452287:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452293:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452298:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452303:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452308:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452322:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452328:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452334:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452339:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452346:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452351:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452356:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452361:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452366:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452371:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452377:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452384:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452406:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452412:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452418:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452423:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452429:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452434:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452440:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452446:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947060.452453:0:20963:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790947060.466954:0:20963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947060.466968:0:20963:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790947060.466974:0:20963:0:(genops.c:885:class_export_put()) final put ffff94b0c70f7800/MDS_uuid 00000020:00000080:1.0:1790947060.466978:0:20963:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c70f7800/MDS_uuid for MDS 00000020:01000000:1.0:1790947060.466999:0:20963:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790947060.467161:0:20963:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1790947060.494954:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947061.524529:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947062.543302:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947063.502255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947063.502334:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947063.502338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947063.502341:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790947063.502345:0:36:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947063.502353:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1790947063.502358:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790947063.502371:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94b0c7ea3800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947063.502423:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c80a80 x1877943593958784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947063.502486:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947063.502490:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790947063.502492:0:36:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947063.502495:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1790947063.502499:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790947063.502505:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94b0c15c4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947063.502516:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c80380 x1877943593959040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790947063.502550:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790947063.502566:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593959168:0@lo:400:kworker.0 00000400:00000100:2.0:1790947063.502617:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959168 offset 0 length 224: 4 00000100:00100000:0.0:1790947063.502709:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593958912:0@lo:400:kworker.0 00000400:00000100:0.0:1790947063.502733:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593958912 offset 0 length 224: 4 00000100:00100000:3.0:1790947063.502909:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1877943593958784:0@lo:38:kworker.0 00000400:00000100:3.0:1790947063.502937:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593958784 offset 0 length 520: 4 00000100:00100000:3.0:1790947063.502959:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593959040:0@lo:38:kworker.0 00000400:00000100:3.0:1790947063.502987:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959040 offset 0 length 520: 4 00010000:00010000:1.0:1790947063.565988:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947064.590000:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790947064.763288:0:21164:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790947064.777768:0:21164:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790947064.777852:0:21164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947064.777905:0:21164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947064.777912:0:21164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947064.777920:0:21164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947064.777944:0:21164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790947064.777952:0:21164:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790947064.778152:0:21164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947064.778165:0:21164:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c80a80 x1877943593958784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790947078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947064.778188:0:21164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790947064.778194:0:21164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790947064.778202:0:21164:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790947064.778207:0:21164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947064.778211:0:21164:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c80a80 x1877943593958784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790947078 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947064.778218:0:21164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790947064.778220:0:21164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:2.0:1790947064.778386:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947064.778396:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947064.778405:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600c00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:2.0:1790947064.778409:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947064.778420:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790947064.778429:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947064.778448:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790947064.778452:0:17177:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790947064.778455:0:17177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790947064.778473:0:17177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:2.0:1790947064.778478:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947064.778485:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6de492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de499 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947064.778498:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947064.778500:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947064.778502:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947064.778596:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1877943593958784:0@lo:38:kworker.0 00000100:00080000:0.0:1790947064.780124:0:21164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790947064.780141:0:21164:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c82d80 x1877943593958912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947064.780162:0:21164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1790947064.780203:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593958912:0@lo:400:kworker.0 00000100:00080000:0.0:1790947064.780238:0:21164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790947064.780271:0:21164:0:(import.c:65:import_set_state_nolock()) ffff94b1c50bd000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790947064.780466:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1877943593959296:0@lo:39:umount.0 00000400:00000100:1.0:1790947064.780529:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959296 offset 0 length 224: 4 00000100:00080000:3.0:1790947065.551292:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790947065.551304:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947065.551308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790947065.551328:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790947065.552185:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593959424:0@lo:400:kworker.0 00000400:00000100:1.0:1790947065.552246:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959424 offset 0 length 224: 4 00010000:00010000:1.0:1790947065.614058:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790947066.070913:0:19509:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790947066.070922:0:19509:0:(genops.c:885:class_export_put()) final put ffff94b0c15c3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790947066.071967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c15c3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790947066.072029:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c15c4800 for lustre-OST0001 00000001:00100000:2.0:1790947066.072919:0:18692:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790947066.072925:0:18692:0:(genops.c:885:class_export_put()) final put ffff94b1c5560000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790947066.073015:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c5560000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790947066.073056:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1c5564800 for lustre-OST0000 00010000:00010000:2.0:1790947066.638910:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947067.667057:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790947068.558562:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790947068.558579:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790947068.558583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790947068.558587:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790947068.558787:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790947068.558816:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1877943593959552:0@lo:400:kworker.0 00000400:00000100:2.0:1790947068.558935:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959552 offset 0 length 224: 4 00010000:00010000:1.0:1790947068.686044:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947069.711460:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947070.734274:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947070.926060:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947060/real 1790947060] req@ffff94b0c7c82a00 x1877943593958656/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790947070 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947070.926104:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7c82a00 x1877943593958656/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790947070 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790947070.926130:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790947070.926164:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1790947070.926169:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3638:1877943593958656:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1790947070.928245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790947070.928259:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790947070.928264:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790947070.928276:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1790947070.928293:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790947070.928311:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.129@tcp: import ffff94b2003aa800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947070.928364:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e74e00 x1877943593959680/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790947070.928405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790947070.928410:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790947070.928542:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947070.928582:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1877943593959808:0@lo:400:kworker.0 00000400:00000100:3.0:1790947070.928657:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959808 offset 0 length 224: 4 00000100:00100000:1.0:1790947070.928687:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3638:1877943593959680:0@lo:250:kworker.0 00000400:00000100:1.0:1790947070.928715:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877943593959680 offset 0 length 520: 4 00010000:00010000:1.0:1790947071.759180:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947072.782060:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947073.806099:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947074.830011:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947075.022352:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947064/real 1790947064] req@ffff94b0c7e76680 x1877943593959296/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790947074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947075.022382:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7e76680 x1877943593959296/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790947074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790947075.022401:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1c50bd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790947075.022435:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1877943593959296:0@lo:39:umount.0 00000100:00080000:0.0:1790947075.022512:0:21164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790947075.022517:0:21164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790947075.022521:0:21164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790947075.023414:0:21164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023428:0:21164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023436:0:21164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023443:0:21164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023468:0:21164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947075.023476:0:21164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023483:0:21164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023489:0:21164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023495:0:21164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947075.023522:0:21164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790947075.023527:0:21164:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1790947075.023551:0:21164:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1790947075.023555:0:21164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1790947075.023560:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947075.023564:0:21164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790947075.023576:0:21164:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff94b1fd2ab380) has no exports 00000020:00080000:0.0:1790947075.023602:0:21164:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff94b1fd2ab380) has no exports 00010000:00010000:3.0:1790947075.023663:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947075.023672:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023680:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb47600 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947075.023685:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023696:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947075.023703:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947075.023710:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790947075.023713:0:17177:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1790947075.023715:0:17177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1790947075.023730:0:17177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:3.0:1790947075.023734:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023741:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1ecb47600/0xe6f6b79c2d6de468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de46f expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023757:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947075.023761:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023779:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b400 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947075.023782:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023789:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947075.023796:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947075.023802:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790947075.023804:0:17177:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790947075.023806:0:17177:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790947075.023812:0:17177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:3.0:1790947075.023815:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023821:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6de7cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de7d3 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947075.023830:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947075.023833:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947075.023834:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790947075.025243:0:21164:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1d8ed4600 - data ffff94b1c8fa4a20/ffff94b0c1b45400 00000020:01000000:0.0:1790947075.025367:0:21164:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1c8bf2f00 - data ffff94b1ef5b1af8/ffff94b0c84fc800 00010000:00010000:2.0:1790947075.030014:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790947075.040512:0:21164:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790947075.058527:0:21164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de47d 00000020:00000080:2.0:1790947075.058663:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b0c7117800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790947075.058712:0:21164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1fe244000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790947075.058717:0:21164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1fe244000 2 00000020:01000004:2.0:1790947075.058720:0:21164:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94b1fe244000 from lustre-OST0000 00000020:00000080:2.0:1790947075.058743:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947075.058753:0:21164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790947075.058756:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b1d88ed000/lustre-OST0000_UUID 00000020:00000080:2.0:1790947075.058759:0:21164:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1d88ed000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790947075.058766:0:21164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790947075.058814:0:21164:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790947075.058819:0:21164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790947075.058822:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947075.058826:0:21164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790947075.058833:0:21164:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94b0c7ea7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790947075.058838:0:21164:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff94b1c69ab380) has exports, disconnecting them 00000020:00080000:2.0:1790947075.058843:0:21164:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94b0c7ea7000), last request at 1790946995 00000020:00000080:2.0:1790947075.058847:0:21164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de4a7 00000020:00080000:2.0:1790947075.060119:0:21164:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c7ea7000): rc 0 00000020:00000080:2.0:1790947075.060128:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b0c7ea7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790947075.064488:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7117800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790947075.064515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7ea7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790947075.064849:0:21164:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790947075.064854:0:21164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790947075.064891:0:21164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790947075.064898:0:21164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790947075.065069:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790947075.065078:0:21164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1790947075.065095:0:21164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790947075.065099:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790947075.065103:0:21164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790947075.065111:0:21164:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff94b1c31d0000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790947075.065117:0:21164:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff94b0c8613380) has exports, disconnecting them 00000020:00080000:3.0:1790947075.065120:0:21164:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff94b1c31d0000), last request at 1790946995 00000020:00000080:3.0:1790947075.065124:0:21164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de4b5 00000020:00080000:3.0:1790947075.065138:0:21164:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b1c31d0000): rc 0 00000020:00000080:3.0:1790947075.065144:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b1c31d0000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790947075.065772:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c7ea3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790947075.065780:0:8:0:(genops.c:885:class_export_put()) final put ffff94b1d88ee800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1790947075.065783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1d88ee800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1790947075.065789:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1790947075.065854:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c31d0000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1790947075.074203:0:21164:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790947075.074212:0:21164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790947075.074216:0:21164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790947075.074224:0:21164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790947075.074258:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b1c50bd000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790947075.074444:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947075.074452:0:21164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1790947075.074457:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b0c7ea4800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1790947075.074461:0:21164:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c7ea4800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1790947075.074467:0:21164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1790947075.074535:0:21164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1fe244000 1 00000020:00000080:0.0:1790947075.074552:0:21164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de45a 00000020:00000080:0.0:1790947075.074559:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b1c2fed800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790947075.074569:0:21164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790947075.074577:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c2fed800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790947075.074587:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947075.074661:0:21164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790947075.074676:0:21164:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff94b1c69a8000) has no exports 00000020:00000080:0.0:1790947075.112382:0:21164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947075.112395:0:21164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1790947075.112401:0:21164:0:(genops.c:885:class_export_put()) final put ffff94b1fe246000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1790947075.112406:0:21164:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe246000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1790947075.112419:0:21164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1790947075.112553:0:21164:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94b1fe245000 00000020:02000400:0.0:1790947075.112663:0:21164:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790947075.855683:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790947076.302047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790947076.302067:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947076.302071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790947076.302073:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790947076.302170:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790947076.302189:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593959936:0@lo:400:kworker.0 00000400:00000100:1.0:1790947076.302264:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593959936 offset 0 length 224: 4 00010000:00010000:2.0:1790947076.879183:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947077.902791:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947078.097735:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947063/real 1790947063] req@ffff94b0c7c80380 x1877943593959040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790947078 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.097767:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7c80380 x1877943593959040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790947078 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790947078.097788:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790947078.097809:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790947078.097813:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593959040:0@lo:38:kworker.0 00000100:00080000:2.0:1790947078.097898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947078.097904:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947078.097907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947078.097910:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790947078.097913:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947078.097919:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1790947078.097925:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790947078.097936:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94b0c15c4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947078.099340:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c80380 x1877943593960064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790947078.099423:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593960192:0@lo:400:kworker.0 00000400:00000100:2.0:1790947078.099474:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593960192 offset 0 length 224: 4 00000100:00100000:0.0:1790947078.100402:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593960064:0@lo:38:kworker.0 00000400:00000100:0.0:1790947078.100443:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593960064 offset 0 length 520: 4 00000020:01000004:2.0:1790947078.925068:0:21366:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:2.0:1790947078.932931:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790947078.937568:0:21366:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790947078.937660:0:21366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947078.937675:0:21366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947078.937683:0:21366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947078.937690:0:21366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947078.937731:0:21366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790947078.937737:0:21366:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790947078.937762:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790947078.937772:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c80380 x1877943593960064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790947098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.937790:0:21366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790947078.937796:0:21366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790947078.937802:0:21366:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790947078.937806:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790947078.937809:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c80380 x1877943593960064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790947098 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.937815:0:21366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790947078.937818:0:21366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00010000:00010000:3.0:1790947078.937957:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947078.937965:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947078.937972:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb46000 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947078.937977:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947078.937986:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947078.937992:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947078.937999:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790947078.938001:0:17177:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790947078.938003:0:17177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790947078.938016:0:17177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:3.0:1790947078.938021:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947078.938038:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1ecb46000/0xe6f6b79c2d6de52c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de533 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947078.938049:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947078.938050:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947078.938052:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947078.943111:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593960064:0@lo:38:kworker.0 00000100:00080000:2.0:1790947078.944010:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790947078.944023:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c81f80 x1877943593959168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.944050:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c84e5c00 x1877943593959424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947081 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.944060:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e77b80 x1877943593959552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.944076:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7e75c00 x1877943593959808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947086 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.944088:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b1c2eb1c00 x1877943593959936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947092 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.944095:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c80e00 x1877943593960192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947094 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947078.944121:0:21366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790947078.944126:0:21366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790947078.944149:0:21366:0:(import.c:65:import_set_state_nolock()) ffff94b0c8695000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790947078.944242:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1877943593959552:0@lo:400:kworker.0 00000100:00100000:0.0:1790947078.944278:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1877943593960320:0@lo:39:umount.0 00000400:00000100:0.0:1790947078.944324:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943593960320 offset 0 length 224: 4 00000100:00100000:3.0:1790947078.944410:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1877943593959808:0@lo:400:kworker.0 00000100:00100000:1.0:1790947078.945043:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593960192:0@lo:400:kworker.0 00000100:00100000:1.0:1790947078.945053:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593959936:0@lo:400:kworker.0 00000100:00100000:1.0:1790947078.945060:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593959424:0@lo:400:kworker.0 00000100:00100000:1.0:1790947078.945066:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593959168:0@lo:400:kworker.0 00010000:00010000:3.0:1790947079.950986:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947080.974447:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947081.998270:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947083.022113:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947083.470884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947083.470895:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790947084.046239:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947085.070030:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947070/real 1790947070] req@ffff94b0c7e74e00 x1877943593959680/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790947085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947085.070063:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7e74e00 x1877943593959680/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790947085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790947085.070084:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947085.070102:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790947085.070106:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3638:1877943593959680:0@lo:250:kworker.0 00010000:00010000:3.0:1790947085.070275:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947085.070314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790947085.070321:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790947085.070324:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947085.070329:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1790947085.070334:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.129@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790947085.070344:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.129@tcp: import ffff94b2003aa800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947085.070375:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c81f80 x1877943593960448/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790947085.070449:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3638:1877943593960448:0@lo:250:kworker.0 00000400:00000100:0.0:1790947085.070489:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877943593960448 offset 0 length 520: 4 00010000:00010000:3.0:1790947086.094169:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947087.124088:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947088.141981:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947078/real 1790947078] req@ffff94b0c7c83b80 x1877943593960320/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790947088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947088.142028:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7c83b80 x1877943593960320/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790947088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790947088.142048:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c8695000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790947088.142809:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1877943593960320:0@lo:39:umount.0 00010000:00010000:3.0:1790947088.142892:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947088.144608:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790947088.144616:0:21366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790947088.144623:0:21366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790947088.147607:0:21366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147634:0:21366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147640:0:21366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147742:0:21366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147837:0:21366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947088.147848:0:21366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147855:0:21366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147878:0:21366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947088.147884:0:21366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150175:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947088.150189:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150200:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601c00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947088.150205:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150214:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947088.150222:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947088.150228:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790947088.150248:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1790947088.150263:0:19582:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:3.0:1790947088.150267:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150274:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7601c00/0xe6f6b79c2d6de502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de509 expref: -99 pid: 19508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150292:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947088.150296:0:19582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150302:0:19582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a400 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947088.150305:0:19582:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150312:0:19582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947088.150318:0:19582:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947088.150323:0:19582:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790947088.150325:0:19582:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1790947088.150329:0:19582:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:3.0:1790947088.150332:0:19582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947088.150339:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947088.150341:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947088.150343:0:19582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947088.150592:0:21366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790947088.150602:0:21366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646a400/0xe6f6b79c2d6de7be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de7c5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947088.150617:0:21366:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1790947088.150624:0:21366:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1790947088.150626:0:21366:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790947088.150656:0:21366:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790947088.150719:0:21366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790947088.150725:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947088.150731:0:21366:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790947088.150735:0:21366:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff94b1fd2acd40) has no exports 00000020:00080000:2.0:1790947088.150758:0:21366:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff94b1fd2acd40) has no exports 00010000:00010000:1.0:1790947088.150991:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790947088.155282:0:21366:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b0c86a07e0 - data ffff94b1c8f155e8/ffff94b1e7a40400 00000020:01000000:2.0:1790947088.155403:0:21366:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff94b1d8ed4060 - data ffff94b1ef728288/ffff94b0c15c9400 00100000:10000000:3.0:1790947088.172196:0:21366:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790947088.190374:0:21366:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de517 00000020:00000080:1.0:1790947088.190387:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b0c67dc800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790947088.190410:0:21366:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1ff851800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790947088.190414:0:21366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1ff851800 2 00000020:01000004:1.0:1790947088.190418:0:21366:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94b1ff851800 from lustre-OST0001 00000020:00000080:1.0:1790947088.190440:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947088.190450:0:21366:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790947088.190453:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b0c70f3000/lustre-OST0001_UUID 00000020:00000080:1.0:1790947088.190456:0:21366:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c70f3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790947088.190461:0:21366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790947088.190595:0:21366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 38422016-28cf-4c0a-9d3b-4ac65d884a5a->MGS 00010000:00010000:1.0:1790947088.190611:0:21366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7600200/0xe6f6b79c2d6de326 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de32d expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790947088.190624:0:21366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600200/0xe6f6b79c2d6de326 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de32d expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947088.190631:0:21366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790947088.190634:0:21366:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790947088.190638:0:21366:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790947088.190652:0:21366:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:1.0:1790947088.190655:0:21366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7600200/0xe6f6b79c2d6de326 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de32d expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1790947088.190820:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c67dc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:1.0:1790947088.190902:0:21366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7600600/0xe6f6b79c2d6de215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6f6b79c2d6de21c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790947088.190979:0:21366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600600/0xe6f6b79c2d6de215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6f6b79c2d6de21c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947088.190985:0:21366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790947088.190988:0:21366:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790947088.190990:0:21366:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790947088.191003:0:21366:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94b2003aa800 00010000:00010000:1.0:1790947088.191007:0:21366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7600600/0xe6f6b79c2d6de215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6f6b79c2d6de21c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790947088.191025:0:21366:0:(import.c:65:import_set_state_nolock()) ffff94b2003aa800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790947088.191029:0:21366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790947088.191031:0:21366:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790947088.191033:0:21366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790947088.191037:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790947088.191056:0:21366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94b0c7c81f80 x1877943593960448/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790947105 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790947088.191072:0:21366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790947088.191075:0:21366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1790947088.191277:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38422016-28cf-4c0a-9d3b-4ac65d884a5a:3638:1877943593960448:0@lo:250:kworker.0 10000000:01000000:1.0:1790947088.192990:0:21366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790947088.193012:0:21366:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de200 00000020:00000080:1.0:1790947088.193023:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b0c70f5800/38422016-28cf-4c0a-9d3b-4ac65d884a5a 00000020:01000000:1.0:1790947088.193043:0:21366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.129@tcp (flags='') 00000020:00000080:1.0:1790947088.193055:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790947088.193064:0:21366:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790947088.193068:0:21366:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff94b0c7100000) has no exports 10000000:01000000:2.0:1790947088.193189:0:17186:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1790947088.193274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c70f5800/38422016-28cf-4c0a-9d3b-4ac65d884a5a for MGC192.168.203.129@tcp 10000000:01000000:1.0:1790947088.193586:0:21366:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.129@tcp: client import never connected 00000100:00080000:1.0:1790947088.193590:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790947088.193593:0:21366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790947088.193596:0:21366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790947088.193598:0:21366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790947088.193659:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947088.193675:0:21366:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.129@tcp (uuid 38422016-28cf-4c0a-9d3b-4ac65d884a5a) 00000020:01000000:1.0:1790947088.193684:0:21366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790947088.193687:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790947088.193691:0:21366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790947088.193698:0:21366:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94b1fd367800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790947088.193703:0:21366:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff94b0c73d0000) has exports, disconnecting them 00000020:00080000:1.0:1790947088.193706:0:21366:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94b1fd367800), last request at 1790947011 00000020:00000080:1.0:1790947088.193710:0:21366:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de541 00000020:00080000:1.0:1790947088.193722:0:21366:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b1fd367800): rc 0 00000020:00000080:1.0:1790947088.193725:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b1fd367800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790947088.193992:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b2003aa800 for MGC192.168.203.129@tcp 00000020:00000080:2.0:1790947088.194000:0:37:0:(genops.c:885:class_export_put()) final put ffff94b0c774d000/38422016-28cf-4c0a-9d3b-4ac65d884a5a 00000020:00000080:2.0:1790947088.194002:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c774d000/38422016-28cf-4c0a-9d3b-4ac65d884a5a for MGC192.168.203.129@tcp 00000020:01000000:2.0:1790947088.194008:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.129@tcp (38422016-28cf-4c0a-9d3b-4ac65d884a5a) 00000020:00000080:2.0:1790947088.194763:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fd367800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790947088.196027:0:21366:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790947088.196034:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790947088.196039:0:21366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790947088.196045:0:21366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790947088.196243:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790947088.196252:0:21366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1790947088.196259:0:21366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790947088.196264:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790947088.196268:0:21366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790947088.196276:0:21366:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff94b0c8691000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790947088.196283:0:21366:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff94b0c86119c0) has exports, disconnecting them 00000020:00080000:0.0:1790947088.196287:0:21366:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff94b0c8691000), last request at 1790947011 00000020:00000080:0.0:1790947088.196291:0:21366:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de556 00000020:00080000:0.0:1790947088.196305:0:21366:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94b0c8691000): rc 0 00000020:00000080:0.0:1790947088.196311:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b0c8691000/lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1790947088.197045:0:21366:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790947088.197050:0:21366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790947088.197053:0:21366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790947088.197057:0:21366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790947088.197645:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c15c4000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790947088.197655:0:37:0:(genops.c:885:class_export_put()) final put ffff94b0c15c1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790947088.197658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c15c1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790947088.197675:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790947088.197741:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b0c8691000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1790947088.197747:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94b0c8695000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1790947088.199354:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790947088.261035:0:19582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790947088.271470:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790947088.271815:0:17173:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff94b1ef8e3000:17173] 1 exiting: rc = 0 00000100:00100000:0.0:1790947088.271958:0:17172:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff94b1e1d5d000:17172] 0 exiting: rc = 1 00000100:00100000:2.0:1790947088.272169:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.272467:0:17175:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff94b1ef8e3a00:17175] 1 exiting: rc = 0 00000100:00100000:0.0:1790947088.272646:0:17174:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff94b1ef8e3400:17174] 0 exiting: rc = 1 00000100:00100000:0.0:1790947088.272721:0:17176:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff94b1ef8e2c00:17176] 2 exiting: rc = 0 00000100:00100000:2.0:1790947088.272819:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.272827:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.272833:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.272839:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.272846:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.272853:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273049:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273067:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273072:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273077:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273082:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273087:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273093:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273098:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273103:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273107:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273113:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273118:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273124:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273130:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273136:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273141:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273146:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273151:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273157:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273162:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273168:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273173:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273179:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273185:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273190:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273196:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273201:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273207:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273212:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273218:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273224:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273229:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273235:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273241:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273247:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273252:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273268:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273275:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273281:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273286:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273292:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273298:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273304:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273310:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273315:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273320:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273325:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273329:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273334:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273340:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273345:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273351:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273357:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273362:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273368:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273373:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273379:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790947088.273384:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790947088.274490:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790947088.274572:0:21366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1790947088.274578:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b1fd364000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1790947088.274582:0:21366:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fd364000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1790947088.274588:0:21366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1790947088.274636:0:21366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1ff851800 1 00000020:00000080:2.0:1790947088.274643:0:21366:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe6f6b79c2d6de4fb 00000020:00000080:2.0:1790947088.274649:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b1fe171800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1790947088.274667:0:21366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1790947088.274672:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790947088.274676:0:21366:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790947088.274680:0:21366:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff94b1fd35b380) has no exports 00000020:00000080:0.0:1790947088.275609:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe171800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790947088.321700:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947088.321714:0:21366:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790947088.321720:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b1fe39c000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790947088.321725:0:21366:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1fe39c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790947088.321751:0:21366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790947088.322537:0:21366:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94b1ff856000 00000020:01000000:1.0:1790947088.322717:0:21366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790947088.322723:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790947088.322728:0:21366:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790947088.322733:0:21366:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff94b1fd35cd40) has no exports 00000020:00000080:1.0:1790947088.322764:0:21366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790947088.322772:0:21366:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790947088.322776:0:21366:0:(genops.c:885:class_export_put()) final put ffff94b1c2fea000/OSS_uuid 00000020:00000080:1.0:1790947088.323153:0:21366:0:(genops.c:844:class_export_destroy()) destroying export ffff94b1c2fea000/OSS_uuid for OSS 00000020:01000000:1.0:1790947088.323162:0:21366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1790947088.323358:0:18696:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff94b1d2739600:18696] 0 exiting: rc = 1 00000100:00100000:0.0:1790947088.323455:0:18698:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff94b1c8a7e200:18698] 2 exiting: rc = 0 00000100:00100000:0.0:1790947088.323518:0:18697:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff94b0c73c8800:18697] 1 exiting: rc = 0 00000100:00080000:2.0:1790947088.323796:0:17185:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790947088.324657:0:19256:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff94b1e7a22a00:19256] 3 exiting: rc = 0 00000100:00100000:2.0:1790947088.325165:0:19587:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff94b1c6cbd200:19587] 4 exiting: rc = 0 00000100:00100000:1.0:1790947088.327408:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327419:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327426:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327432:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327437:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327443:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327448:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327454:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327459:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327464:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327469:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327474:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327480:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327487:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327503:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327511:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327517:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327523:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327529:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327535:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327541:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327558:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327563:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327569:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327590:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327596:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327601:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327606:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327612:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327852:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327888:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327895:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327902:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327908:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327916:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327921:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327926:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327931:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327937:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327943:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327948:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327953:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327958:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327964:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327969:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327974:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327978:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327984:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327989:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327994:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.327999:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328005:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328011:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328016:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328022:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328027:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328032:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328037:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328042:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328056:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328061:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328067:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328072:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.328077:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947088.329540:0:18699:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94b1e7870400:18699] 0 exiting: rc = 1 00000100:00100000:1.0:1790947088.329912:0:18700:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94b1e7945c00:18700] 1 exiting: rc = 0 00000100:00100000:1.0:1790947088.329968:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.329976:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.329981:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.329986:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.329991:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.329996:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330002:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330007:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330013:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330018:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330023:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330028:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330033:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330038:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330042:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330048:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330054:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330059:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330064:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330069:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330075:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330080:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330085:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330090:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330095:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330100:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330105:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330110:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330115:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330135:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330141:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330148:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330153:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330157:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330162:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330166:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330171:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330176:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330181:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330186:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330191:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330196:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330204:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330209:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330214:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330219:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330224:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330230:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330236:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330243:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330247:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330252:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330258:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330263:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330268:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330273:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330278:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330284:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330290:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330297:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330303:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330308:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330312:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.330318:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947088.332201:0:18702:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94b1e79fa800:18702] 1 exiting: rc = 0 00000100:00100000:3.0:1790947088.333468:0:20331:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff94b0c73c8200:20331] 3 exiting: rc = 0 00000100:00100000:0.0:1790947088.337038:0:18701:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94b1e79fb200:18701] 0 exiting: rc = 1 00000100:00100000:0.0:1790947088.337248:0:18703:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94b1e7945600:18703] 2 exiting: rc = 0 00000100:00100000:1.0:1790947088.337480:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337488:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337513:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337521:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337525:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337531:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337536:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337541:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337555:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337561:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337568:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337578:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337584:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337590:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337596:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337602:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337608:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337613:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337618:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337648:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337656:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337661:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337667:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337673:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337678:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337684:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337690:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337695:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337701:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337707:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337713:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337718:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337724:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337730:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337735:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337756:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337764:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337771:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337792:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337801:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337809:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337816:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337825:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337852:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337885:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337891:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337897:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337902:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337908:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337913:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337920:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337925:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337931:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337936:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337942:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337948:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337954:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337960:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337965:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337971:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337977:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337982:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.337987:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.338003:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947088.343616:0:18704:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94b1e79fae00:18704] 0 exiting: rc = 1 00000100:00100000:2.0:1790947088.344036:0:18705:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff94b1e79faa00:18705] 1 exiting: rc = 0 00000100:00100000:1.0:1790947088.344197:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344203:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344215:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344222:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344227:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344231:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344248:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344253:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344258:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344262:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344267:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344271:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344276:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344280:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344285:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344291:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344296:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344301:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344307:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344339:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344346:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344351:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344356:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344362:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344367:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344372:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344378:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344383:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344387:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344391:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344396:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344401:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344405:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344411:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344415:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344421:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344427:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344432:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344437:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344441:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344446:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344459:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344464:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344469:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344473:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344478:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344484:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344499:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344504:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344513:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344517:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344523:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344528:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344533:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344538:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344552:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344559:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344564:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344569:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344574:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344579:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344585:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344589:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.344594:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790947088.345424:0:18706:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94b1e79fac00:18706] 0 exiting: rc = 1 00000100:00100000:0.0:1790947088.345822:0:18707:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94b1e79fba00:18707] 1 exiting: rc = 0 00000100:00100000:1.0:1790947088.346119:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346126:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346132:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346139:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346145:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346150:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346156:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346161:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346167:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346173:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346179:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346185:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346214:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346220:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346226:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346232:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346238:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346244:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346250:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346256:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346262:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346268:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346276:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346283:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346304:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346312:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346318:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346324:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346330:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346336:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346341:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346346:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346352:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346357:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346363:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346369:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346390:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346396:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346402:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346408:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346413:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346420:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346425:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346430:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346439:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346447:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346453:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346466:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.346486:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.348955:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.348970:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.348976:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.348983:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.348989:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.348995:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349001:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349007:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349013:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349019:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349025:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349052:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349060:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349065:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790947088.349072:0:21366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790947088.360240:0:21366:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790947109.971330:0:22132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790947121.884410:0:22731:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790947121.884417:0:22731:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1790947121.884419:0:22731:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790947121.884526:0:22731:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94b1fcde2000 00000020:01000004:0.0:1790947121.884550:0:22731:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790947121.884557:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790947121.884573:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94b0c8613380) 00000020:00000080:0.0:1790947121.884586:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790947121.950453:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790947121.951950:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.952956:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.953178:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.953474:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.953723:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.954007:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.954307:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.954554:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.954798:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.955047:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.955293:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.955547:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.955734:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.955977:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.956221:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.956509:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.956718:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.956918:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.957095:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.957371:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.957600:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.957766:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.958063:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.958342:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.958597:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.958807:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.959009:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.959460:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.960118:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.960574:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.960873:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790947121.961152:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.961619:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790947121.962536:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1790947121.962814:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790947121.963536:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790947121.963845:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.964110:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790947121.964407:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.964726:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.964966:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.965186:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790947121.965516:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790947121.965756:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.965983:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790947121.968246:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.969466:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.969834:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.970117:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.970584:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.970760:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1790947121.971016:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1790947121.971741:0:22731:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790947121.972038:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790947121.972045:0:22731:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790947121.972056:0:22731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6dea6c 00000020:01000004:3.0:1790947121.972072:0:22731:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1790947121.972077:0:22731:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790947121.972081:0:22731:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94b1fcde2000 from MGS 00000020:01000004:3.0:1790947121.972085:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790947121.972094:0:22731:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff94b1fd3599c0) 00000020:00000080:3.0:1790947121.972104:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790947121.972161:0:22731:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1fcde2000 from MGS, refs=2 00080000:01000000:3.0:1790947121.972166:0:22731:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790947121.972170:0:22731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6dea7a 00000100:00100000:3.0:1790947121.972258:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790947121.972402:0:22731:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790947121.972408:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790947121.973084:0:22731:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790947121.973091:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790947121.974099:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790947121.974394:0:22731:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790947121.974399:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790947121.974854:0:22731:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790947121.974921:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790947121.975404:0:22731:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790947121.975410:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790947121.976032:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947121.976035:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947121.976036:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947121.976397:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947121.976400:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947121.976402:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947121.976898:0:22731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790947121.978342:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790947121.982055:0:22731:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790947121.983038:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790947121.983087:0:22731:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790947121.983121:0:22731:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790947121.983732:0:22731:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790947121.984114:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790947121.984284:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790947121.984290:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790947121.987021:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790947121.987036:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790947121.991978:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790947121.991993:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790947121.994196:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790947121.994231:0:22731:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:3.0:1790947121.994233:0:22731:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790947121.994464:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:3.0:1790947121.994478:0:22731:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (ffff94b1fd358000) 00000020:00000080:3.0:1790947121.994493:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790947121.994585:0:22731:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c67dc800@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1790947121.994735:0:22731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:3.0:1790947121.994753:0:22731:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1790947121.994909:0:22748:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790947121.998006:0:22749:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790947121.998193:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid 4e22e84b-45e4-41c3-ac10-e0c57bc0d735) 00000020:00000080:3.0:1790947121.998222:0:22731:0:(genops.c:1384:class_connect()) connect: client 4e22e84b-45e4-41c3-ac10-e0c57bc0d735, cookie 0xe6f6b79c2d6dea88 00000100:00080000:3.0:1790947121.998235:0:22731:0:(import.c:545:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790947121.998246:0:22731:0:(import.c:666:import_select_connection()) MGC192.168.203.129@tcp: import ffff94b0c67dc800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947121.998286:0:22731:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e4a80 x1877943593960576/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947121.998307:0:22731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4e22e84b-45e4-41c3-ac10-e0c57bc0d735->MGS 00000020:01000004:3.0:1790947121.998329:0:22731:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790947121.998333:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790947121.998346:0:22731:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94b1fd35cd40) 00000020:00000080:3.0:1790947121.998357:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790947121.999495:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3638:1877943593960576:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790947121.999571:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947121.999708:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593960576 00000100:00100000:2.0:1790947121.999717:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593960576 00000100:00100000:2.0:1790947121.999758:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790947121.999766:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1877943593960576:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790947121.999792:0:22744:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4e22e84b-45e4-41c3-ac10-e0c57bc0d735@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:2.0:1790947121.999815:0:22744:0:(genops.c:1384:class_connect()) connect: client 4e22e84b-45e4-41c3-ac10-e0c57bc0d735, cookie 0xe6f6b79c2d6dea96 00000100:00080000:2.0:1790947121.999954:0:22744:0:(import.c:65:import_set_state_nolock()) ffff94b1fcf2f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947122.000005:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+5:3638:x1877943593960576:12345-0@lo:250:mount.lustre.0 Request processed in 238us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947122.000013:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790947122.001420:0:3638:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790947122.001435:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1790947122.001442:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790947122.001458:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790947122.001463:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c67dc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790947122.001467:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790947122.001482:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790947122.001490:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3638:1877943593960576:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790947122.026237:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947122.026754:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790947122.026760:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790947122.029467:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790947122.029480:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790947122.030002:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790947122.030009:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790947122.030901:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790947122.031097:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790947122.031103:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790947122.031893:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790947122.031901:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790947122.077144:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947122.077582:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790947122.077589:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790947122.078720:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790947122.078730:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790947122.079514:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947122.079692:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790947122.079697:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790947122.080234:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790947122.080304:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790947122.080775:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947122.081031:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790947122.081036:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790947122.081691:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790947122.081698:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790947122.082238:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947122.082514:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790947122.082520:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790947122.083459:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790947122.083468:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790947122.106301:0:22731:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790947122.106581:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790947122.106589:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790947122.115347:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790947122.115364:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790947122.116463:0:22731:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790947122.116473:0:22731:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790947122.118897:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790947122.118927:0:22731:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1790947122.118934:0:22731:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790947122.119034:0:22731:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790947122.119083:0:22731:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790947122.119088:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790947122.119089:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790947122.119094:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790947122.119096:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790947122.119097:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790947122.119098:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790947122.119099:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790947122.119101:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790947122.119102:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790947122.119104:0:22731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790947122.119106:0:22731:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790947122.119108:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790947122.119109:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790947122.119110:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790947122.119111:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790947122.119112:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790947122.119114:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790947122.119115:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790947122.119116:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790947122.119117:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790947122.119117:0:22731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790947122.119141:0:22731:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790947122.119160:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593960704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790947122.119229:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.119279:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.119682:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593960704 00000100:00100000:1.0:1790947122.119690:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593960704 00000100:00100000:1.0:1790947122.119733:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790947122.119742:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+5:22731:x1877943593960704:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790947122.119787:0:22747:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790947122.119789:0:22747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790947122.119792:0:22747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1790947122.120140:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790947122.120675:0:22747:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1790947122.122282:0:22769:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1790947122.122288:0:22769:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1790947122.122291:0:22769:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1790947122.122294:0:22769:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1790947122.122712:0:22769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1790947122.127295:0:22747:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790947122.127309:0:22747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790947122.131510:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+5:22731:x1877943593960704:12345-0@lo:253:mount.lustre.0 Request processed in 11758us (12271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.131525:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790947122.131611:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593960704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790947122.131625:0:22731:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790947122.131629:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790947122.131630:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790947122.131632:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790947122.131633:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790947122.131634:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790947122.131636:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790947122.131637:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790947122.131638:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790947122.131640:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790947122.131641:0:22731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790947122.131659:0:22731:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94b1fcde2000 from lustre-MDT0000 10000000:01000000:3.0:1790947122.131690:0:22731:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790947122.131704:0:22731:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790947122.131709:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94b1fd358000 10000000:01000000:3.0:1790947122.131713:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790947122.131720:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94b1fd358000 from 1 10000000:01000000:3.0:1790947122.131723:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790947122.131759:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.131769:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.131778:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.131794:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593960832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947122.131824:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.132001:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790947122.132214:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593960832 00000100:00100000:0.0:1790947122.132222:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593960832 00000100:00100000:0.0:1790947122.132356:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790947122.132365:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+5:22731:x1877943593960832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790947122.132390:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947122.132404:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c646aa00/0xe6f6b79c2d6deaa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dea9d expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947122.132425:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c646aa00/0xe6f6b79c2d6deaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dea9d expref: 6 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947122.132435:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c646aa00/0xe6f6b79c2d6deaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dea9d expref: 6 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947122.132443:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c646aa00, rc 0) 00000100:00100000:0.0:1790947122.132483:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+6:22731:x1877943593960832:12345-0@lo:101:mount.lustre.0 Request processed in 119us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947122.132490:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790947122.132564:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593960832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947122.132577:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.132586:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.132638:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593960960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947122.132662:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.133253:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790947122.133461:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593960960 00000100:00100000:2.0:1790947122.133467:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593960960 00000100:00100000:0.0:1790947122.133548:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790947122.133558:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+6:22731:x1877943593960960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947122.133662:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+6:22731:x1877943593960960:12345-0@lo:501:mount.lustre.0 Request processed in 106us (998us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790947122.133670:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790947122.133737:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593960960:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790947122.133772:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790947122.133797:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.133806:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947122.133814:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94b1fcde2000 10000000:01000000:3.0:1790947122.133830:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790947122.133835:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94b1fcde2000 10000000:01000000:3.0:1790947122.133837:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790947122.133841:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94b1fcde2000 from 1 10000000:01000000:3.0:1790947122.133844:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790947122.133881:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.133889:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.133897:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.133912:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947122.133949:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.134279:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.134569:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593961088 00000100:00100000:1.0:1790947122.134575:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593961088 00000100:00100000:1.0:1790947122.134602:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790947122.134608:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+6:22731:x1877943593961088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947122.134618:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947122.134633:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cee00/0xe6f6b79c2d6deab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deaab expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.134651:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cee00/0xe6f6b79c2d6deab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deaab expref: 7 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.134661:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cee00/0xe6f6b79c2d6deab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deaab expref: 7 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.134668:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cee00, rc 0) 00000100:00100000:1.0:1790947122.134711:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+7:22731:x1877943593961088:12345-0@lo:101:mount.lustre.0 Request processed in 102us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.134716:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790947122.134794:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947122.134807:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deab2 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.134815:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deab2 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947122.134834:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790947122.134843:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deab2 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.134850:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29000/0xe6f6b79c2d6deaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deab2 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947122.134884:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790947122.134898:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790947122.134903:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94b1fcde2000 10000000:01000000:3.0:1790947122.134905:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790947122.134909:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790947122.134911:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790947122.134934:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.134941:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.134947:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.134962:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947122.134990:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.135007:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.135157:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593961216 00000100:00100000:1.0:1790947122.135162:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593961216 00000100:00100000:1.0:1790947122.135178:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790947122.135184:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+7:22731:x1877943593961216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947122.135190:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947122.135204:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cf000/0xe6f6b79c2d6deac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deab9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.135218:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cf000/0xe6f6b79c2d6deac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deab9 expref: 8 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.135226:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cf000/0xe6f6b79c2d6deac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deab9 expref: 8 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.135232:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cf000, rc 0) 00000100:00100000:1.0:1790947122.135278:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+8:22731:x1877943593961216:12345-0@lo:101:mount.lustre.0 Request processed in 93us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.135284:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790947122.135540:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947122.135552:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deac0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.135565:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deac0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.135614:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947122.135637:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.135657:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.135708:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593961344 00000100:00100000:1.0:1790947122.135712:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593961344 00000100:00100000:1.0:1790947122.135730:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790947122.135735:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+8:22731:x1877943593961344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947122.135851:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22731:x1877943593961344:12345-0@lo:501:mount.lustre.0 Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.135884:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790947122.136016:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947122.136129:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947122.136167:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.136195:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.136305:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593961472 00000100:00100000:1.0:1790947122.136310:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593961472 00000100:00100000:1.0:1790947122.136329:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790947122.136334:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22731:x1877943593961472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947122.136945:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22731:x1877943593961472:12345-0@lo:503:mount.lustre.0 Request processed in 608us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.136952:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790947122.137128:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593961472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947122.137579:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22770:1877943593961600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.137626:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.137652:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593961600 00000100:00100000:1.0:1790947122.137656:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593961600 00000100:00100000:1.0:1790947122.137679:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790947122.137689:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22770:x1877943593961600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.138329:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c84b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.138547:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22770:x1877943593961600:12345-0@lo:502:llog_process_th.0 Request processed in 857us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.138556:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790947122.138667:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22770:1877943593961600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790947122.138696:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947122.138708:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.138710:0:22770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790947122.138715:0:22770:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790947122.138718:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790947122.138734:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94b1fd35b380) 00000020:00000080:3.0:1790947122.138750:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790947122.138756:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790947122.138827:0:22770:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790947122.138834:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6deace 00000020:00000080:3.0:1790947122.139311:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790947122.139316:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947122.139320:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.139322:0:22770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790947122.139334:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947122.139338:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.139339:0:22770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790947122.139342:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790947122.139351:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94b1ef9099c0) 00000020:00000080:3.0:1790947122.139362:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790947122.139366:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790947122.139368:0:22770:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790947122.139371:0:22770:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790947122.139377:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790947122.139423:0:22770:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1fcde2000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790947122.139436:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94b1ef90cd40) 00000020:00000080:3.0:1790947122.139443:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790947122.139502:0:22770:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790947122.139508:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6deae3 00000020:00000080:3.0:1790947122.139657:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790947122.139662:0:22770:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790947122.139666:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe6f6b79c2d6deaea 00080000:01000000:3.0:1790947122.139670:0:22770:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790947122.139674:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6deaf1 00010000:00010000:1.0:1790947122.201347:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790947122.201817:0:22770:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1790947122.209333:0:22770:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790947122.213941:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94b0c73d4d40) 00000020:00000080:1.0:1790947122.213967:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790947122.214165:0:22770:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790947122.214172:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6deaff 00000020:00000080:1.0:1790947122.215445:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790947122.223424:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe6f6b79c2d6deb06 00000020:00000080:1.0:1790947122.225123:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790947122.225136:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947122.225339:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947122.225342:0:22770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790947122.225347:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790947122.225349:0:22770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1790947122.225351:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790947122.225352:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790947122.225353:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790947122.225356:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947122.225357:0:22770:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790947122.225360:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947122.225364:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947122.225366:0:22770:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790947122.225370:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790947122.225518:0:22770:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790947122.225546:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947122.225550:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947122.225551:0:22770:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790947122.225554:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947122.225558:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947122.225559:0:22770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790947122.225562:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790947122.225567:0:22770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:0.0:1790947122.225596:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790947122.225611:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff94b0c8614d40) 00000020:00000080:0.0:1790947122.225628:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790947122.225632:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790947122.225687:0:22770:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790947122.225692:0:22770:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790947122.225698:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6deb14 00010000:00080000:0.0:1790947122.225739:0:22770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c5ac4000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1790947122.228236:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1790947122.229162:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790947122.229177:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790947122.229212:0:22770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790947122.229232:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6deb1b 00000100:00080000:1.0:1790947122.229358:0:22770:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790947122.229369:0:22770:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94b0c5ac4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947122.229412:0:22770:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb1180 x1877943593961728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790947122.229474:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593961728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790947122.229548:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.229651:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593961728 00000100:00100000:3.0:1790947122.229659:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593961728 00000100:00100000:3.0:1790947122.229690:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790947122.229698:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1877943593961728:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1790947122.229713:0:22757:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1790947122.232614:0:22770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790947122.232766:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790947122.232773:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.232775:0:22770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790947122.232780:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790947122.232782:0:22770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1790947122.232784:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790947122.232785:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790947122.232787:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790947122.232790:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.232791:0:22770:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790947122.232794:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790947122.232799:0:22770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790947122.232803:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.232804:0:22770:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790947122.232808:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790947122.232812:0:22770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:1.0:1790947122.232839:0:22770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790947122.232841:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790947122.232873:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94b0c73d3380) 00000020:00000080:1.0:1790947122.232894:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790947122.232899:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790947122.232977:0:22770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790947122.232983:0:22770:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790947122.232989:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6deb29 00010000:00080000:1.0:1790947122.233022:0:22770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c7ea3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1790947122.233248:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1790947122.241390:0:22770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790947122.241648:0:22770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790947122.253147:0:22770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790947122.253501:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:3.0:1790947122.260797:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1877943593961728:12345-0@lo:38:llog_process_th.0 Request processed in 31089us (31239us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790947122.260813:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790947122.261951:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790947122.261959:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790947122.261963:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593961728:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790947122.270764:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1790947122.273407:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790947122.273415:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790947122.274305:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790947122.274319:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790947122.274364:0:22770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790947122.274388:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6deb30 00000100:00080000:2.0:1790947122.274399:0:22770:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790947122.274410:0:22770:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94b0c7ea3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947122.274444:0:22770:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c82680 x1877943593961856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947122.274471:0:22770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790947122.274543:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790947122.274548:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947122.274550:0:22770:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790947122.274554:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790947122.274557:0:22770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1790947122.274559:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790947122.274561:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790947122.274563:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790947122.274566:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947122.274568:0:22770:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790947122.274583:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790947122.274588:0:22770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790947122.274591:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947122.274593:0:22770:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790947122.274597:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790947122.274601:0:22770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000100:00100000:1.0:1790947122.274616:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593961856:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1790947122.274624:0:22770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790947122.274628:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790947122.274644:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94b1fd2ab380) 00000020:00000080:2.0:1790947122.274656:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1790947122.274662:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000400:00000100:1.0:1790947122.274683:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593961856 offset 0 length 520: 4 00000004:00080000:2.0:1790947122.274727:0:22770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790947122.274734:0:22770:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790947122.274740:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6f6b79c2d6deb3e 00010000:00080000:2.0:1790947122.275155:0:22770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c774b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1790947122.275425:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790947122.275487:0:22770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790947122.275499:0:22770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790947122.282446:0:22770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790947122.283756:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1790947122.283972:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1790947122.285106:0:22778:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790947122.285112:0:22778:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790947122.286130:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790947122.286143:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790947122.286183:0:22770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790947122.286204:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6deb45 00000100:00080000:1.0:1790947122.286214:0:22770:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790947122.286224:0:22770:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94b0c774b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947122.286259:0:22770:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb1180 x1877943593961984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790947122.289166:0:22770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790947122.289291:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790947122.289299:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.289301:0:22770:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790947122.289305:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790947122.289309:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.289310:0:22770:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790947122.289313:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790947122.289314:0:22770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790947122.289316:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790947122.289319:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.289320:0:22770:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790947122.289322:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790947122.289324:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.289325:0:22770:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790947122.289329:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790947122.289371:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22770:1877943593962112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.289455:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.289496:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c614cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790947122.289549:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962112 00000100:00100000:2.0:1790947122.289558:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962112 00000100:00100000:0.0:1790947122.289582:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593961984:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1790947122.289599:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790947122.289610:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22770:x1877943593962112:12345-0@lo:502:llog_process_th.0 00000400:00000100:0.0:1790947122.289617:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593961984 offset 0 length 520: 4 00000100:00100000:2.0:1790947122.289746:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22770:x1877943593962112:12345-0@lo:502:llog_process_th.0 Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947122.289755:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947122.289894:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22770:1877943593962112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790947122.289924:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790947122.289928:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947122.289930:0:22770:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790947122.289933:0:22770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1790947122.290153:0:22731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1790947122.290173:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790947122.290194:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deac0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947122.290205:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28200/0xe6f6b79c2d6deab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deac0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947122.290212:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b1fcde2000 from 1 10000000:01000000:0.0:1790947122.290215:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947122.290241:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947122.290248:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947122.290258:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947122.290282:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790947122.290320:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947122.290348:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef20da80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.290483:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962240 00000100:00100000:1.0:1790947122.290488:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962240 00000100:00100000:1.0:1790947122.290520:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790947122.290536:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+9:22731:x1877943593962240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947122.290691:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947122.290706:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deb4c expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.290726:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 10 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.290737:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 10 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.290745:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cf200, rc 0) 00000100:00100000:1.0:1790947122.291037:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+10:22731:x1877943593962240:12345-0@lo:101:mount.lustre.0 Request processed in 509us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.291044:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790947122.296790:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947122.296830:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.297027:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.301558:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962368:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790947122.301645:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.301697:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790947122.301716:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962368 00000100:00100000:0.0:1790947122.301724:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962368 00000100:00100000:0.0:1790947122.301786:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790947122.301795:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+10:22731:x1877943593962368:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790947122.301818:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790947122.301823:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790947122.301928:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+10:22731:x1877943593962368:12345-0@lo:256:mount.lustre.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947122.301936:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790947122.302402:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962368:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790947122.303377:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790947122.303405:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.303417:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947122.303427:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1fcde2000 from 1 10000000:01000000:3.0:1790947122.303430:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790947122.303465:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.303474:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.303483:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.303565:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947122.303611:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.303644:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.303669:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962496 00000100:00100000:1.0:1790947122.303676:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962496 00000100:00100000:1.0:1790947122.303766:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790947122.303776:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+10:22731:x1877943593962496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947122.303797:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947122.303812:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deb5a expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.303845:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.303856:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.303895:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cfe00, rc 0) 00000100:00100000:1.0:1790947122.303942:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22731:x1877943593962496:12345-0@lo:101:mount.lustre.0 Request processed in 168us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.303948:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790947122.304018:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947122.304032:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.304040:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947122.304094:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947122.304182:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.304402:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790947122.304451:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962624 00000100:00100000:0.0:1790947122.304456:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962624 00000100:00100000:1.0:1790947122.304706:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790947122.304715:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22731:x1877943593962624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947122.305053:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22731:x1877943593962624:12345-0@lo:501:mount.lustre.0 Request processed in 338us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.305060:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947122.305139:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947122.305183:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947122.305210:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.305231:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790947122.305246:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962752 00000100:00100000:0.0:1790947122.305250:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962752 00000100:00100000:0.0:1790947122.305278:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790947122.305285:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22731:x1877943593962752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790947122.305378:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22731:x1877943593962752:12345-0@lo:503:mount.lustre.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947122.305385:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947122.305425:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593962752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947122.306139:0:22780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22780:1877943593962880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790947122.306180:0:22780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.306210:0:22780:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.306259:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593962880 00000100:00100000:1.0:1790947122.306263:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593962880 00000100:00100000:1.0:1790947122.306372:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790947122.306381:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22780:x1877943593962880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.307238:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22780:x1877943593962880:12345-0@lo:502:llog_process_th.0 Request processed in 855us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947122.307406:0:22780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22780:1877943593962880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790947122.307438:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1790947122.307692:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00000080:3.0:1790947122.307761:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.307764:0:22780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790947122.307773:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b1fcde2000 00000020:00000080:3.0:1790947122.307775:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947122.308094:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947122.308098:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.308100:0:22780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790947122.308103:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947122.308107:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.308108:0:22780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790947122.308112:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b1fcde2000 00000020:00000080:3.0:1790947122.308115:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947122.308163:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947122.308167:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.308169:0:22780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790947122.308172:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947122.308174:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.308176:0:22780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790947122.308179:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b1fcde2000 00000020:00000080:3.0:1790947122.308182:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947122.308200:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947122.308203:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.308205:0:22780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790947122.308207:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947122.308210:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.308211:0:22780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790947122.308215:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b1fcde2000 00000020:00000080:3.0:1790947122.308218:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790947122.310715:0:22780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22780:1877943593963008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790947122.311010:0:22780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947122.311084:0:22780:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c569cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.311128:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963008 00000100:00100000:1.0:1790947122.311135:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963008 00000100:00100000:1.0:1790947122.311216:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790947122.311225:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22780:x1877943593963008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.311368:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22780:x1877943593963008:12345-0@lo:502:llog_process_th.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.311376:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790947122.311456:0:22780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22780:1877943593963008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790947122.311491:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947122.311497:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947122.311500:0:22780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790947122.311505:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790947122.312096:0:22731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790947122.312118:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790947122.312177:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.312190:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947122.312249:0:22731:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790947122.312252:0:22731:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94b1fcde2000 10000000:01000000:1.0:1790947122.312255:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94b1fcde2000 10000000:01000000:1.0:1790947122.312260:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790947122.312266:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94b1fcde2000 from 1 10000000:01000000:1.0:1790947122.312278:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790947122.312307:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.312316:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.312326:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947122.312343:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593963136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790947122.312379:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.312412:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790947122.312521:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963136 00000100:00100000:3.0:1790947122.312537:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963136 00000100:00100000:3.0:1790947122.312586:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790947122.312596:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22731:x1877943593963136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947122.312607:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947122.312620:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1f6c29600/0xe6f6b79c2d6deb6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deb68 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.312641:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c29600/0xe6f6b79c2d6deb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb68 expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.312652:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1f6c29600/0xe6f6b79c2d6deb6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb68 expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947122.312660:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c29600, rc 0) 00000100:00100000:3.0:1790947122.312692:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593963136:12345-0@lo:101:mount.lustre.0 Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947122.312699:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790947122.313063:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593963136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947122.313077:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb6f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.313086:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deb6f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947122.313134:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593963264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947122.313159:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.313175:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.313189:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963264 00000100:00100000:1.0:1790947122.313193:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963264 00000100:00100000:1.0:1790947122.313214:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790947122.313221:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593963264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947122.313337:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593963264:12345-0@lo:501:mount.lustre.0 Request processed in 115us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.313343:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790947122.313371:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593963264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947122.313398:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593963392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947122.313432:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.313445:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.313457:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963392 00000100:00100000:1.0:1790947122.313460:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963392 00000100:00100000:1.0:1790947122.313477:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790947122.313482:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593963392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947122.313560:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593963392:12345-0@lo:503:mount.lustre.0 Request processed in 77us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.313787:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790947122.316463:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593963392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947122.317234:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22783:1877943593963520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.317314:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.317353:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790947122.317467:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963520 00000100:00100000:3.0:1790947122.317474:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963520 00000100:00100000:3.0:1790947122.317522:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790947122.317541:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22783:x1877943593963520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790947122.317902:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22783:x1877943593963520:12345-0@lo:502:llog_process_th.0 Request processed in 362us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947122.317919:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790947122.322524:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22783:1877943593963520:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790947122.322679:0:22783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790947122.322694:0:22783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94b0c73d0000) 00000020:00000080:1.0:1790947122.322714:0:22783:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1790947122.325097:0:22783:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1fcde2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790947122.325106:0:22783:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1fcde2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790947122.325109:0:22783:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1fcde2000 4 00010000:00080000:1.0:1790947122.325144:0:22783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c7f60000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1790947122.327722:0:22783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1790947122.328049:0:22783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790947122.328088:0:22783:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790947122.328101:0:22783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe6f6b79c2d6deb7d 00000100:00080000:1.0:1790947122.328112:0:22783:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790947122.328121:0:22783:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94b0c7f60000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947122.328155:0:22783:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb1f80 x1877943593963648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790947122.328181:0:22783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790947122.328341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877943593963648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790947122.328410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947122.328560:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963648 00000100:00100000:0.0:1790947122.328568:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963648 00000100:00100000:0.0:1790947122.328601:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790947122.328609:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1877943593963648:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790947122.328665:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1877943593963648:12345-0@lo:38:llog_process_th.0 Request processed in 55us (255us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790947122.328679:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790947122.328715:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790947122.328722:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7f60000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947122.328726:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790947122.328729:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877943593963648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790947122.331001:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22783:1877943593963776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.331077:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.331113:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963776 00000100:00100000:1.0:1790947122.331126:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963776 00000100:00100000:1.0:1790947122.331172:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790947122.331181:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22783:x1877943593963776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.332990:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22783:x1877943593963776:12345-0@lo:502:llog_process_th.0 Request processed in 1803us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.333002:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790947122.333060:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.333083:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22783:1877943593963776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.333145:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22783:1877943593963904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.333186:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.333219:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593963904 00000100:00100000:1.0:1790947122.333225:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593963904 00000100:00100000:1.0:1790947122.333272:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790947122.333281:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22783:x1877943593963904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790947122.333357:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22783:x1877943593963904:12345-0@lo:502:llog_process_th.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.333364:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790947122.333397:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.333410:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22783:1877943593963904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790947122.333429:0:22783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790947122.333503:0:22731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790947122.333537:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790947122.333553:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb6f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.333564:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce200/0xe6f6b79c2d6deb68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb6f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790947122.333623:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790947122.333625:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790947122.333627:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947122.333628:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947122.333630:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947122.333632:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947122.333634:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790947122.333636:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790947122.333642:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947122.333644:0:22731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790947122.333648:0:22731:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790947122.333650:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790947122.333652:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790947122.333654:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947122.333655:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947122.333656:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947122.333658:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947122.333659:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790947122.333660:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790947122.333661:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947122.333662:0:22731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790947122.333673:0:22731:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790947122.333682:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593964032:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790947122.333710:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.333724:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1790947122.333750:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964032 00000100:00100000:1.0:1790947122.333753:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964032 00000100:00100000:1.0:1790947122.333779:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790947122.333786:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593964032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790947122.334247:0:22744:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790947122.334261:0:22744:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790947122.337056:0:22744:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790947122.337074:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790947122.337124:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790947122.337130:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790947122.337153:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947122.337172:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947122.337181:0:22768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947122.337218:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947122.337234:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 12 pid: 22746 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947122.337248:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593964160:0@lo:104: 00000100:00100000:2.0:1790947122.337320:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.337638:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22731:x1877943593964032:12345-0@lo:253:mount.lustre.0 Request processed in 3850us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.337650:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790947122.337652:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c64060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947122.338015:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22731:1877943593964032:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790947122.338020:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964160 00000100:00100000:1.0:1790947122.338028:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964160 10000000:01000000:0.0:1790947122.338029:0:22731:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790947122.338034:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790947122.338036:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790947122.338037:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790947122.338038:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790947122.338040:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790947122.338041:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790947122.338042:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790947122.338044:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790947122.338047:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790947122.338048:0:22731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790947122.338065:0:22731:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790947122.338070:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790947122.338084:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593964160:12345-0@lo:104: 00010000:00010000:1.0:1790947122.338097:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338151:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790947122.338157:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593964160:12345-0@lo:104: Request processed in 78us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.338164:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790947122.338186:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947122.338191:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338199:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b400 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:1.0:1790947122.338203:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338212:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790947122.338219:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947122.338226:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790947122.338256:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338269:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790947122.338294:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338301:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6deb4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb53 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338434:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947122.338437:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947122.338440:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947122.338477:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593964288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790947122.338508:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947122.338586:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964288 00000100:00100000:1.0:1790947122.338590:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964288 00010000:00010000:1.0:1790947122.338606:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 12 pid: 22746 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947122.338635:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790947122.338642:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:3641:x1877943593964288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947122.338653:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947122.338658:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 12 pid: 22746 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338667:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 12 pid: 22746 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338683:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.338701:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790947122.339033:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001903804s 00010000:00010000:1.0:1790947122.339038:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339045:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339051:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339059:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339065:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223c00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947122.339069:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339076:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339085:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339094:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790947122.339133:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:3641:x1877943593964288:12345-0@lo:103:ldlm_bl.0 Request processed in 492us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947122.339141:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790947122.339169:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593964288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947122.339190:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6deb53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb4c expref: 11 pid: 22746 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947122.339202:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593964160:0@lo:104: 00010000:00010000:1.0:1790947122.339216:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339225:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339233:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947122.339239:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6deb84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790947122.364550:0:22731:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1790947122.371675:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1790947122.376195:0:22793:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790947122.376611:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:1.0:1790947122.376813:0:22792:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1790947122.376818:0:22792:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:0.0:1790947122.377209:0:22793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790947122.377301:0:22794:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94b1c2eb1c00 x1877943593964416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947122.377314:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000040:01000000:3.0:1790947122.377922:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790947122.377957:0:22731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790947122.380909:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790947122.380982:0:22793:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1790947122.384760:0:22731:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790947122.385154:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790947122.385252:0:22731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790947122.386931:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790947122.387700:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790947122.387739:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790947122.390559:0:22731:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1790947122.392139:0:22731:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1790947122.395220:0:22731:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1790947122.401349:0:22731:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790947122.401386:0:22731:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf9081c4f988 00100000:10000000:2.0:1790947122.401394:0:22731:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790947122.402211:0:22731:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790947122.402227:0:22731:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790947122.402255:0:22731:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790947122.402280:0:22731:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1790947122.403120:0:22731:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790947122.403314:0:22731:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790947123.022068:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947123.343414:0:22787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790947123.343423:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790947123.347138:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790947123.347152:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790947123.406083:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 10000000:01000000:0.0:1790947123.919336:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790947123.919343:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b1fcde2000 from 11 10000000:01000000:0.0:1790947123.919349:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947123.919393:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947123.919404:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947123.919413:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947123.919435:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593964544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947123.919498:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947123.919547:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c660c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790947123.919986:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964544 00000100:00100000:1.0:1790947123.919994:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964544 00000100:00100000:1.0:1790947123.920045:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790947123.920063:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+11:22749:x1877943593964544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790947123.920077:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947123.920090:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deb8b expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947123.920134:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 12 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947123.920144:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 12 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947123.920152:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13ce600, rc 0) 00000100:00100000:1.0:1790947123.920205:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22749:x1877943593964544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947123.920212:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790947123.920386:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593964544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947123.920402:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947123.920411:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947123.920465:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593964672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790947123.920498:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947123.920531:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6d560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947123.920602:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964672 00000100:00100000:0.0:1790947123.920606:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964672 00000100:00100000:0.0:1790947123.920628:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790947123.920634:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22749:x1877943593964672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790947123.920648:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790947123.920663:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790947123.920667:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1790947123.920746:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:22749:x1877943593964672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947123.920754:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790947123.920843:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593964672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790947123.920917:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790947123.920924:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947123.920933:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947124.046257:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947124.367070:0:22787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790947124.367079:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790947124.367225:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1790947124.367277:0:22787:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790947124.367470:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1790947124.438376:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790947125.070058:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947125.460822:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790947126.094469:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947126.479236:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000001:02000400:2.0:1790947126.994893:0:23037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790947127.119251:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947127.509599:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000100:00080000:3.0:1790947127.509986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790947127.509993:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790947127.509997:0:36:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947127.510006:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:3.0:1790947127.510026:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790947127.510042:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94b0c5ac4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947127.510071:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e5180 x1877943593964928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947127.510085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947127.510089:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947127.510092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947127.510095:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947127.510098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790947127.510101:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790947127.510103:0:36:0:(import.c:65:import_set_state_nolock()) ffff94b0c7f60000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947127.510109:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94b0c7f60000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947127.510120:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e7480 x1877943593965056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947127.510148:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947127.510170:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593964800:0@lo:400:kworker.0 00000100:00100000:3.0:1790947127.510269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947127.510351:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964800 00000100:00100000:3.0:1790947127.510361:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964800 00000100:00100000:3.0:1790947127.510423:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947127.510434:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:3641:x1877943593964800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947127.510507:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:3641:x1877943593964800:12345-0@lo:400:kworker.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947127.510515:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947127.510585:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593964800:0@lo:400:kworker.0 00000100:00100000:3.0:1790947127.521563:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593964928:0@lo:38:kworker.0 00000100:00100000:3.0:1790947127.521674:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947127.521725:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877943593965056:0@lo:38:kworker.0 00000100:00100000:3.0:1790947127.521762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947127.521902:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964928 00000100:00100000:2.0:1790947127.521913:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964928 00000100:00100000:2.0:1790947127.521953:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790947127.521962:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593964928:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790947127.521986:0:22758:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790947127.522043:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593964928:12345-0@lo:38:kworker.0 Request processed in 80us (368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790947127.522050:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790947127.522142:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790947127.522149:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790947127.522153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593964928:0@lo:38:kworker.0 00000100:00100000:0.0:1790947127.522616:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593965056 00000100:00100000:0.0:1790947127.522622:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593965056 00000100:00100000:0.0:1790947127.522649:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790947127.522656:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877943593965056:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790947127.522678:0:22754:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:0.0:1790947127.522723:0:22754:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe6f6b79c2d6deb99 00000004:00100000:0.0:1790947127.522743:0:22754:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790947127.523046:0:22754:0:(import.c:65:import_set_state_nolock()) ffff94b1eee29000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790947127.523164:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877943593965056:12345-0@lo:38:kworker.0 Request processed in 507us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947127.523172:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790947127.523305:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94b0c84e7480 x1877943593965056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790947137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790947127.523395:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790947127.523406:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790947127.523412:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790947127.523415:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7f60000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790947127.523424:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877943593965056:0@lo:38:kworker.0 00000020:00000004:0.0:1790947128.095314:0:23089:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790947128.096250:0:23089:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790947128.143171:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947128.527189:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000020:00000004:1.0:1790947129.002467:0:23139:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790947129.002667:0:23139:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790947129.170421:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947129.552625:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790947130.193057:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947130.575819:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1790947131.218702:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947131.600389:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1790947132.239035:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790947132.627031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790947132.627040:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790947132.627045:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947132.627057:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:3.0:1790947132.627065:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790947132.627081:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94b0c5ac4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947132.627112:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e5180 x1877943593965312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947132.627135:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947132.627148:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947132.627151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947132.627155:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790947132.627217:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947122/real 1790947122] req@ffff94b1c2eb1180 x1877943593961984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947132 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947132.627246:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b1c2eb1180 x1877943593961984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947132 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947132.627256:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947122/real 1790947122] req@ffff94b0c7c82680 x1877943593961856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947132 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947132.627267:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593965184:0@lo:400:kworker.0 00000100:00100000:3.0:1790947132.627270:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7c82680 x1877943593961856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947132 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947132.627291:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593965312:0@lo:38:kworker.0 00000100:00100000:1.0:1790947132.627460:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593965440:0@lo:400:kworker.0 00000100:00100000:2.0:1790947132.627728:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1790947132.633211:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947132.633383:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593965184 00000100:00100000:0.0:1790947132.633395:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593965184 00000100:00100000:0.0:1790947132.633468:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790947132.633481:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:3639:x1877943593965184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947132.646042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790947132.646291:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790947132.646314:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790947132.646321:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593961984:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790947132.646330:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790947132.646336:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790947132.646339:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593961856:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790947132.647772:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593965312 00000100:00100000:3.0:1790947132.647793:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593965312 00000100:00100000:3.0:1790947132.647872:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790947132.647894:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593965312:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790947132.647931:0:22758:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790947132.648029:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593965312:12345-0@lo:38:kworker.0 Request processed in 135us (1997us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790947132.648038:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790947132.648085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947132.648090:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790947132.648095:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947132.648101:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:3.0:1790947132.648107:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790947132.648118:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94b0c7ea3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947132.648160:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e6d80 x1877943593965568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947132.648178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947132.648182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790947132.648184:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947132.648187:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:3.0:1790947132.648190:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790947132.648195:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94b0c774b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947132.648207:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e7b80 x1877943593965696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947132.648241:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593965568:0@lo:8:kworker.0 00000400:00000100:3.0:1790947132.648280:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593965568 offset 0 length 520: 4 00000100:00100000:3.0:1790947132.648314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593965696:0@lo:8:kworker.0 00000400:00000100:3.0:1790947132.648334:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593965696 offset 0 length 520: 4 00000100:00080000:3.0:1790947132.648376:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790947132.648382:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790947132.648385:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593965312:0@lo:38:kworker.0 00000100:00100000:1.0:1790947132.653886:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947132.655069:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593965440 00000100:00100000:3.0:1790947132.655083:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593965440 00000100:00100000:3.0:1790947132.655151:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790947132.655163:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593965440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947132.655246:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593965440:12345-0@lo:400:kworker.0 Request processed in 86us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947132.655254:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790947132.655953:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94b0c84e5500 x1877943593965440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947132.655974:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593965440:0@lo:400:kworker.0 00000100:00100000:0.0:1790947132.656442:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:3639:x1877943593965184:12345-0@lo:400:kworker.0 Request processed in 22961us (23244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947132.656465:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790947132.656544:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593965184:0@lo:400:kworker.0 00010000:00010000:1.0:1790947133.262140:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947133.646311:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1790947134.292884:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947134.606519:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790947134.674962:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1790947135.323793:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947135.694951:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1790947136.334122:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790947136.581743:0:23484:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790947136.581755:0:23484:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790947136.581757:0:23484:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790947136.585530:0:23484:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94b0c7116800 00000020:01000004:1.0:1790947136.585552:0:23484:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1790947136.585565:0:23484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790947136.585581:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff94b0c73d19c0) 00000020:00000080:1.0:1790947136.585596:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790947136.713067:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790947136.715819:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00000100:00100000:3.0:1790947136.718167:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00100000:10000000:2.0:1790947136.730297:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1790947136.731562:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1790947136.731976:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1790947136.732230:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790947136.734529:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790947136.739065:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790947136.739790:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790947136.740096:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790947136.740387:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790947136.741016:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790947136.741464:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790947136.741795:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790947136.743984:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1790947136.748572:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1790947136.749693:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790947136.750492:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790947136.750908:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790947136.751209:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790947136.751838:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1790947136.752220:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790947136.752563:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1790947136.752818:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.753944:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.755326:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.755875:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.756185:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.756431:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.756759:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.757125:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.757428:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.758198:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.758527:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.758755:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.758988:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.759440:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.759628:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.759817:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.760225:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.760497:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790947136.760680:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.760948:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.761268:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.761575:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790947136.761758:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00080000:01000000:3.0:1790947136.763675:0:23484:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790947136.764090:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790947136.764105:0:23484:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790947136.764118:0:23484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6f6b79c2d6deba7 00000020:01000004:3.0:1790947136.764124:0:23484:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790947136.764157:0:23484:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790947136.764160:0:23484:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790947136.764167:0:23484:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790947136.764194:0:23484:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790947136.764198:0:23484:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1790947136.767810:0:23484:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790947136.767850:0:23484:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1790947136.767855:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790947136.767882:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790947136.767884:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790947136.767885:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790947136.767886:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790947136.767888:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790947136.767889:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790947136.767891:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790947136.767892:0:23484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790947136.767896:0:23484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1790947136.767898:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790947136.767905:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790947136.767907:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790947136.767908:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790947136.767909:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790947136.767910:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790947136.767911:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790947136.767911:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790947136.767912:0:23484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790947136.767938:0:23484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790947136.767958:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593965824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790947136.768029:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.768153:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340600 going to sleep for 11 seconds 00000100:00100000:0.0:1790947136.768245:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593965824 00000100:00100000:0.0:1790947136.768253:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593965824 00000100:00100000:0.0:1790947136.768426:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790947136.768437:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:23484:x1877943593965824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790947136.768468:0:22744:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790947136.768471:0:22744:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1790947136.768479:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790947136.768768:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:23484:x1877943593965824:12345-0@lo:253:mount.lustre.0 Request processed in 333us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947136.768776:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790947136.768847:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593965824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790947136.768892:0:23484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790947136.768895:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790947136.768896:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790947136.768897:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790947136.768899:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790947136.768900:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790947136.768901:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790947136.768902:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790947136.768904:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790947136.768905:0:23484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790947136.768922:0:23484:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94b0c7116800 from lustre-MDT0001 10000000:01000000:3.0:1790947136.768944:0:23484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790947136.768947:0:23484:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790947136.768953:0:23484:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94b1fd358000 local copy 00010000:00010000:3.0:1790947136.768961:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947136.769049:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593965952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947136.769077:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.769334:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340000 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.769439:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593965952 00000100:00100000:1.0:1790947136.769444:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593965952 00000100:00100000:2.0:1790947136.769482:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790947136.769499:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:23484:x1877943593965952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947136.769576:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:23484:x1877943593965952:12345-0@lo:501:mount.lustre.0 Request processed in 79us (497us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790947136.769583:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790947136.769648:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593965952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790947136.769666:0:23484:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790947136.769682:0:23484:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790947136.769688:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.769697:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947136.769720:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94b0c7116800 10000000:01000000:3.0:1790947136.769724:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790947136.769728:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94b1fd358000 10000000:01000000:3.0:1790947136.769731:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790947136.769734:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94b1fd358000 from 1 10000000:01000000:3.0:1790947136.769737:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790947136.769758:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.769765:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.769774:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947136.769786:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947136.769810:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.769830:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340000 going to sleep for 11 seconds 00000100:00100000:2.0:1790947136.769887:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966080 00000100:00100000:2.0:1790947136.769891:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966080 00000100:00100000:2.0:1790947136.769910:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790947136.769915:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+12:23484:x1877943593966080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790947136.769923:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947136.769934:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef223800/0xe6f6b79c2d6debb5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6debae expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.769954:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223800/0xe6f6b79c2d6debb5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6debae expref: 13 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.769963:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef223800/0xe6f6b79c2d6debb5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6debae expref: 13 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.769971:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223800, rc 0) 00000100:00100000:2.0:1790947136.769999:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+13:23484:x1877943593966080:12345-0@lo:101:mount.lustre.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947136.770004:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790947136.770070:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947136.770081:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debb5 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770098:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6debb5 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947136.770113:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790947136.770138:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debb5 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770145:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28c00/0xe6f6b79c2d6debae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debb5 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947136.770152:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94b0c7116800 10000000:01000000:3.0:1790947136.770156:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790947136.770159:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94b0c7116800 from 1 10000000:01000000:3.0:1790947136.770161:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790947136.770175:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770182:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770190:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947136.770201:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947136.770223:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.770241:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340000 going to sleep for 11 seconds 00000100:00100000:2.0:1790947136.770282:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966208 00000100:00100000:2.0:1790947136.770286:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966208 00000100:00100000:2.0:1790947136.770301:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790947136.770306:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+13:23484:x1877943593966208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790947136.770313:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947136.770319:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef223400/0xe6f6b79c2d6debc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6debbc expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.770338:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223400/0xe6f6b79c2d6debc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6debbc expref: 14 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.770358:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef223400/0xe6f6b79c2d6debc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6debbc expref: 14 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.770365:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223400, rc 0) 00000100:00100000:2.0:1790947136.770396:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+14:23484:x1877943593966208:12345-0@lo:101:mount.lustre.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947136.770402:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790947136.770572:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947136.770584:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debc3 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770597:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6debc3 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947136.770607:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790947136.770622:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debc3 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770630:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28000/0xe6f6b79c2d6debbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debc3 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947136.770636:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790947136.770639:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790947136.770644:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94b0c7116800 10000000:01000000:3.0:1790947136.770647:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790947136.770650:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1790947136.770652:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790947136.770665:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770672:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.770679:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947136.770691:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947136.770715:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.770727:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340000 going to sleep for 11 seconds 00000100:00100000:2.0:1790947136.770773:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966336 00000100:00100000:2.0:1790947136.770777:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966336 00000100:00100000:2.0:1790947136.770793:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790947136.770799:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+14:23484:x1877943593966336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790947136.770807:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947136.770815:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6debd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6debca expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.770827:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6debd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6debca expref: 15 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.770835:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef223c00/0xe6f6b79c2d6debd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6debca expref: 15 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947136.770842:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223c00, rc 0) 00000100:00100000:2.0:1790947136.770898:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966336:12345-0@lo:101:mount.lustre.0 Request processed in 98us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947136.770904:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790947136.771050:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947136.771060:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debd1 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.771068:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6debd1 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790947136.772467:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1790947136.773063:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790947136.777388:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1790947136.777455:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1790947136.777473:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1790947136.777487:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1790947136.777501:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1790947136.777514:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1790947136.777528:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1790947136.777541:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1790947136.777554:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1790947136.777567:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1790947136.777737:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1790947136.777754:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1790947136.777769:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1790947136.777783:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1790947136.777910:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1790947136.777926:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1790947136.777939:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1790947136.777953:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1790947136.777972:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1790947136.777986:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1790947136.777999:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1790947136.778012:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1790947136.778027:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1790947136.778054:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1790947136.778069:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1790947136.778085:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1790947136.778100:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1790947136.778114:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1790947136.778129:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1790947136.778144:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1790947136.778158:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1790947136.778170:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1790947136.778183:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1790947136.778196:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1790947136.778209:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1790947136.778223:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1790947136.778236:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1790947136.778250:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1790947136.778264:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1790947136.778279:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1790947136.778294:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1790947136.778309:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1790947136.778323:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1790947136.778337:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1790947136.778365:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1790947136.778371:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1790947136.778481:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947136.778546:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947136.779035:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966464 00000100:00100000:0.0:1790947136.779043:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966464 00000100:00100000:0.0:1790947136.779093:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790947136.779104:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947136.779515:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966464:12345-0@lo:501:mount.lustre.0 Request processed in 412us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947136.779524:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790947136.779981:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340900 going to sleep for 11 seconds 00000100:00100000:3.0:1790947136.780004:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947136.780043:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947136.780092:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.780115:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340900 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.780170:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966592 00000100:00100000:1.0:1790947136.780175:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966592 00000100:00100000:1.0:1790947136.780215:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790947136.780223:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966592:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947136.781238:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966592:12345-0@lo:503:mount.lustre.0 Request processed in 1012us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947136.781249:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790947136.781780:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790947136.782345:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790947136.782435:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947136.782501:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.782545:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340000 going to sleep for 11 seconds 00000100:00100000:0.0:1790947136.783340:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966720 00000100:00100000:0.0:1790947136.783350:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966720 00000100:00100000:0.0:1790947136.783401:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790947136.783410:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947136.784242:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966720:12345-0@lo:502:mount.lustre.0 Request processed in 830us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947136.784251:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790947136.784471:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790947136.784914:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1790947136.784944:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1790947136.784961:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1790947136.784974:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1790947136.784987:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1790947136.785002:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1790947136.785014:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1790947136.785025:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1790947136.785036:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1790947136.785048:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1790947136.785059:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1790947136.785070:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1790947136.785081:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1790947136.785091:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1790947136.785102:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1790947136.785113:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1790947136.785123:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1790947136.785133:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1790947136.785146:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1790947136.785158:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1790947136.785170:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1790947136.785184:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1790947136.785198:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1790947136.785211:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1790947136.785235:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1790947136.785246:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1790947136.785256:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1790947136.785267:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1790947136.785277:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1790947136.785288:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1790947136.785299:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1790947136.785309:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1790947136.785319:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1790947136.785330:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1790947136.785341:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1790947136.785353:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1790947136.785366:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1790947136.785377:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1790947136.785389:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1790947136.785402:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1790947136.785415:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1790947136.785440:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1790947136.785451:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1790947136.785463:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1790947136.785498:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947136.785554:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.785816:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340000 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.786726:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966848 00000100:00100000:1.0:1790947136.786737:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966848 00000100:00100000:1.0:1790947136.786933:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790947136.786944:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947136.787102:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593966848:12345-0@lo:502:mount.lustre.0 Request processed in 160us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947136.787111:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790947136.787214:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593966848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947136.787296:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1790947136.787310:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1790947136.788457:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947136.788468:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947136.788471:0:23488:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790947136.788476:0:23488:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1790947136.788479:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790947136.788494:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff94b1ef90b380) 00000020:00000080:3.0:1790947136.788514:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1790947136.788519:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790947136.788590:0:23488:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790947136.788601:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6f6b79c2d6debdf 00000020:00000080:3.0:1790947136.789009:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1790947136.789014:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947136.789019:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947136.789020:0:23488:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790947136.789023:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947136.789027:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947136.789028:0:23488:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1790947136.789031:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790947136.789040:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff94b1ef908000) 00000020:00000080:3.0:1790947136.789051:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1790947136.789055:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790947136.789057:0:23488:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1790947136.789060:0:23488:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1790947136.789065:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790947136.789123:0:23488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b0c7116800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1790947136.789136:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff94b1ef2ecd40) 00000020:00000080:3.0:1790947136.789144:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1790947136.789196:0:23488:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790947136.789201:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6debf4 00000020:00000080:3.0:1790947136.789287:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1790947136.789294:0:23488:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790947136.789298:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe6f6b79c2d6debfb 00080000:01000000:3.0:1790947136.789304:0:23488:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790947136.789307:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6f6b79c2d6dec02 00010000:00010000:0.0:1790947136.934995:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1790947136.935806:0:23488:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1790947136.941478:0:23488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790947136.949908:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1790947136.949923:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790947136.949930:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947136.949932:0:23488:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1790947136.949936:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790947136.949941:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947136.949943:0:23488:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1790947136.949946:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790947136.949951:0:23488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:2.0:1790947136.949980:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790947136.949997:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff94b1fd2a8000) 00000020:00000080:2.0:1790947136.950020:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1790947136.950027:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790947136.950111:0:23488:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1790947136.950119:0:23488:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790947136.950125:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6f6b79c2d6dec10 00010000:00080000:2.0:1790947136.950158:0:23488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c15c5000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1790947136.951770:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1790947136.966499:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790947136.966513:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790947136.966573:0:23488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790947136.966596:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6dec17 00000100:00080000:0.0:1790947136.966606:0:23488:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790947136.966616:0:23488:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94b0c15c5000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947136.966652:0:23488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e77100 x1877943593966976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947136.966783:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593966976:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790947136.966850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947136.966977:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593966976 00000100:00100000:2.0:1790947136.966999:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593966976 00000100:00100000:2.0:1790947136.967034:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790947136.967042:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1877943593966976:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790947136.967065:0:22758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:2.0:1790947136.967096:0:22758:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6dec1e 00000004:00100000:2.0:1790947136.967110:0:22758:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790947136.967115:0:22758:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1790947136.968296:0:23488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1790947136.968393:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947136.968399:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947136.968401:0:23488:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790947136.968405:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790947136.968407:0:23488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790947136.968409:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790947136.968411:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790947136.968412:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790947136.968415:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947136.968425:0:23488:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790947136.968428:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947136.968433:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947136.968443:0:23488:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790947136.968447:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790947136.968493:0:23488:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790947136.968506:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947136.968509:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947136.968510:0:23488:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790947136.968513:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790947136.968514:0:23488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1790947136.968516:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790947136.968517:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790947136.968519:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790947136.968522:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947136.968523:0:23488:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790947136.968525:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790947136.968528:0:23488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790947136.968531:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947136.968532:0:23488:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790947136.968535:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790947136.968539:0:23488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1790947136.968559:0:23488:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790947136.968562:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790947136.968577:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff94b0c8610000) 00000020:00000080:0.0:1790947136.968592:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790947136.968597:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790947136.968653:0:23488:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790947136.968658:0:23488:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790947136.968674:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6f6b79c2d6dec2c 00010000:00080000:0.0:1790947136.968701:0:23488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c774c800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1790947136.968941:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1790947136.969369:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790947136.969374:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790947136.969382:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947136.969388:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:2.0:1790947136.969393:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790947136.969400:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94b0c5ac4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947136.969429:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c82a00 x1877943593967232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790947136.969609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593967104:0@lo:400:kworker.0 00000100:00100000:0.0:1790947136.969675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947136.969731:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593967104 00000100:00100000:0.0:1790947136.969739:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593967104 00000100:00100000:0.0:1790947136.969776:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790947136.969784:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:3641:x1877943593967104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947136.969825:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:3641:x1877943593967104:12345-0@lo:400:kworker.0 Request processed in 42us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947136.969832:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790947136.969933:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593967104:0@lo:400:kworker.0 00000100:00100000:3.0:1790947136.970243:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593967232:0@lo:38:kworker.0 00000100:00100000:3.0:1790947136.970273:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947136.970399:0:22757:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1790947136.970408:0:22757:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1790947136.970611:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593967232 00000100:00100000:1.0:1790947136.970617:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593967232 00000100:00100000:1.0:1790947136.970704:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790947136.970710:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1877943593967232:12345-0@lo:38:kworker.0 00000040:01000000:0.0:1790947136.972625:0:23488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790947136.973240:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790947136.974672:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790947136.975925:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790947136.976119:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1790947136.976187:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947136.976194:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947136.976196:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947136.976199:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790947136.976269:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790947136.976288:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877943593967360:0@lo:400:kworker.0 00000100:00100000:1.0:1790947136.976784:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1877943593967232:12345-0@lo:38:kworker.0 Request processed in 6068us (6505us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790947136.976788:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947136.976805:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790947136.977347:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790947136.977355:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947136.977359:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790947136.977363:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593967232:0@lo:38:kworker.0 00000100:00100000:0.0:1790947136.977393:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593967360 00000100:00100000:0.0:1790947136.977399:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593967360 00000100:00100000:0.0:1790947136.977448:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790947136.977457:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877943593967360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947136.977519:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877943593967360:12345-0@lo:400:kworker.0 Request processed in 62us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947136.977527:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790947136.977715:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94b0c7c82d80 x1877943593967360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947136.977728:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877943593967360:0@lo:400:kworker.0 00000040:00080000:3.0:1790947136.977959:0:23494:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790947136.977965:0:23494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790947136.978838:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790947136.978853:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000100:00080000:3.0:1790947136.978922:0:22758:0:(import.c:65:import_set_state_nolock()) ffff94b0c7736800 : changing import state from RECOVER to FULL 00000004:01000000:1.0:1790947136.978924:0:23488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790947136.978947:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6dec33 00000100:00080000:1.0:1790947136.978956:0:23488:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790947136.978965:0:23488:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94b0c774c800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947136.978995:0:23488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb1f80 x1877943593967488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790947136.979011:0:23488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1790947136.979016:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1877943593966976:12345-0@lo:38:llog_process_th.0 Request processed in 11971us (12163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947136.979027:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:1.0:1790947136.979085:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790947136.979090:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947136.979092:0:23488:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790947136.979095:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790947136.979097:0:23488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1790947136.979099:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790947136.979100:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790947136.979102:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790947136.979104:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947136.979105:0:23488:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790947136.979108:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790947136.979112:0:23488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790947136.979115:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790947136.979117:0:23488:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790947136.979120:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790947136.979123:0:23488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:1.0:1790947136.979142:0:23488:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790947136.979145:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790947136.979157:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff94b1d7ef3380) 00000100:00080000:2.0:1790947136.979168:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1790947136.979171:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00080000:2.0:1790947136.979174:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947136.979177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947136.979181:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1790947136.979196:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790947136.979265:0:23488:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1790947136.979271:0:23488:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790947136.979277:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6f6b79c2d6dec41 00010000:00080000:1.0:1790947136.979302:0:23488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b1f4132000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1790947136.979511:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790947136.979574:0:23488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790947136.979589:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1790947136.980590:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593967488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790947136.980652:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593967488 offset 0 length 520: 4 00000100:00100000:0.0:1790947136.980706:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790947136.980722:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790947136.980730:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790947136.980736:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790947136.980739:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c15c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790947136.980762:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593966976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790947136.981158:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593967616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947136.981205:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947136.981244:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593967616 00000100:00100000:0.0:1790947136.981250:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593967616 00000100:00100000:0.0:1790947136.981288:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790947136.981297:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1877943593967616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790947136.981325:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790947136.981367:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1877943593967616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947136.981374:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790947136.981425:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593967616:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790947136.983068:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947136.983321:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1790947136.983487:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1790947136.986223:0:23496:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790947136.986230:0:23496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790947136.988799:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790947136.988816:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790947136.988904:0:23488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790947136.988930:0:23488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6dec48 00000100:00080000:1.0:1790947136.988942:0:23488:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790947136.988955:0:23488:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947136.989063:0:23488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb2300 x1877943593967744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947136.989102:0:23488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1790947136.989146:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593967744:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1790947136.989175:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790947136.989182:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947136.989184:0:23488:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790947136.989187:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790947136.989192:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947136.989193:0:23488:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790947136.989198:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790947136.989200:0:23488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790947136.989203:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790947136.989207:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947136.989208:0:23488:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790947136.989211:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790947136.989216:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000400:00000100:0.0:1790947136.989216:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593967744 offset 0 length 520: 4 00000020:00000080:2.0:1790947136.989219:0:23488:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790947136.989226:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790947136.989259:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790947136.989263:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947136.989265:0:23488:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790947136.989269:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1790947136.989415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947136.989429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947136.989432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947136.989434:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1790947136.989793:0:23484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1790947136.989824:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790947136.989847:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debd1 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947136.989882:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28a00/0xe6f6b79c2d6debca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6debd1 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947136.989903:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b0c7116800 from 1 10000000:01000000:0.0:1790947136.989906:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947136.989932:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947136.989940:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947136.989951:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947136.989969:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593967872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790947136.990008:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947136.990038:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.990165:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593967872 00000100:00100000:1.0:1790947136.990172:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593967872 00000100:00100000:1.0:1790947136.990227:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790947136.990236:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+15:23484:x1877943593967872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947136.990250:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947136.990264:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dec4f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947136.990288:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 16 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947136.990297:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 16 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947136.990317:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cf200, rc 0) 00000100:00100000:1.0:1790947136.990372:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:23484:x1877943593967872:12345-0@lo:101:mount.lustre.0 Request processed in 136us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947136.990378:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790947136.990497:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593967872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947136.990512:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.990520:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947136.991162:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968000:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790947136.991208:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.991338:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340840 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.992623:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968000 00000100:00100000:1.0:1790947136.992633:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968000 00000100:00100000:1.0:1790947136.992687:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790947136.992697:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:23484:x1877943593968000:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790947136.992718:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790947136.992740:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790947136.992743:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790947136.992854:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:23484:x1877943593968000:12345-0@lo:256:mount.lustre.0 Request processed in 158us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947136.992884:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790947136.993035:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790947136.993665:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790947136.993689:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.993700:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947136.993709:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b0c7116800 from 1 10000000:01000000:3.0:1790947136.993720:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790947136.993749:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.993757:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.993765:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947136.993783:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947136.993821:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.993848:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340840 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.994128:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968128 00000100:00100000:1.0:1790947136.994134:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968128 00000100:00100000:1.0:1790947136.994176:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790947136.994241:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:23484:x1877943593968128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947136.994252:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947136.994264:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dec5d expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947136.994283:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947136.994294:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947136.994313:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cfa00, rc 0) 00000100:00100000:1.0:1790947136.994356:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968128:12345-0@lo:101:mount.lustre.0 Request processed in 117us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947136.994362:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790947136.994615:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947136.994631:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947136.994640:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790947136.996763:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1790947136.997577:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790947136.998393:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1790947136.998441:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1790947136.998455:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1790947136.998468:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1790947136.998481:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1790947136.998494:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1790947136.998506:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1790947136.998519:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1790947136.998531:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1790947136.998554:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1790947136.998579:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1790947136.998600:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1790947136.998606:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1790947136.998708:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947136.998769:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947136.998813:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c33400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790947136.999458:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968256 00000100:00100000:1.0:1790947136.999468:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968256 00000100:00100000:1.0:1790947136.999524:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790947136.999534:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947136.999665:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968256:12345-0@lo:501:mount.lustre.0 Request processed in 132us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947136.999673:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790947137.000611:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947137.000771:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947137.000823:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947137.000916:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c33400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947137.010079:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968384 00000100:00100000:2.0:1790947137.010094:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968384 00000100:00100000:2.0:1790947137.010578:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790947137.010590:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790947137.010767:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968384:12345-0@lo:503:mount.lustre.0 Request processed in 180us (9943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947137.010776:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790947137.010901:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790947137.011323:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790947137.011403:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947137.011467:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947137.020296:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968512 00000100:00100000:3.0:1790947137.020361:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340840 going to sleep for 11 seconds 00000100:00100000:1.0:1790947137.020376:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968512 00000100:00100000:1.0:1790947137.030981:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790947137.031008:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947137.031462:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968512:12345-0@lo:502:mount.lustre.0 Request processed in 456us (19994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947137.031470:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790947137.036791:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790947137.045081:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790947137.045123:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1790947137.045760:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1790947137.045779:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1790947137.045793:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1790947137.045807:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1790947137.045820:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1790947137.045833:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1790947137.046784:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790947137.046828:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1790947137.046841:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1790947137.046946:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947137.047434:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947137.047484:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ebd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947137.047533:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968640 00000100:00100000:2.0:1790947137.047542:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968640 00000100:00100000:2.0:1790947137.047592:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790947137.047608:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947137.047732:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968640:12345-0@lo:502:mount.lustre.0 Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947137.047740:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790947137.048320:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790947137.048393:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1790947137.048405:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790947137.052628:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947137.052643:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052646:0:23498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790947137.052655:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b0c7116800 00000020:00000080:0.0:1790947137.052658:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947137.052666:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947137.052668:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052670:0:23498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790947137.052672:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947137.052675:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052676:0:23498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790947137.052680:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b0c7116800 00000020:00000080:0.0:1790947137.052682:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947137.052749:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947137.052753:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052755:0:23498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790947137.052771:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947137.052775:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052776:0:23498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790947137.052779:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b0c7116800 00000020:00000080:0.0:1790947137.052781:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947137.052802:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947137.052805:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052806:0:23498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790947137.052808:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947137.052811:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052812:0:23498:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790947137.052815:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b0c7116800 00000020:00000080:0.0:1790947137.052817:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947137.052839:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947137.052842:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947137.052843:0:23498:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790947137.052846:0:23498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1790947137.052978:0:23484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790947137.053478:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790947137.053501:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947137.053515:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947137.053575:0:23484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790947137.053578:0:23484:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94b0c7116800 10000000:01000000:3.0:1790947137.053581:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94b0c7116800 10000000:01000000:3.0:1790947137.053586:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790947137.053591:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94b0c7116800 from 1 10000000:01000000:3.0:1790947137.053593:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790947137.053627:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947137.053636:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947137.053647:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947137.053740:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790947137.053806:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947137.053842:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340840 going to sleep for 11 seconds 00000100:00100000:0.0:1790947137.057327:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968768 00000100:00100000:0.0:1790947137.057339:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968768 00000100:00100000:0.0:1790947137.057392:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790947137.057401:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:23484:x1877943593968768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790947137.057430:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947137.057449:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c646ac00/0xe6f6b79c2d6dec72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dec6b expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.057475:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c646ac00/0xe6f6b79c2d6dec72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec6b expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.057486:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c646ac00/0xe6f6b79c2d6dec72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec6b expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.057494:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c646ac00, rc 0) 00000100:00100000:0.0:1790947137.057580:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593968768:12345-0@lo:101:mount.lustre.0 Request processed in 180us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947137.057589:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790947137.057669:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790947137.057691:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec72 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.057700:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dec72 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790947137.068446:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1790947137.069916:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790947137.070150:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1790947137.070179:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1790947137.070424:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1790947137.070442:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1790947137.070457:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1790947137.070472:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1790947137.070486:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1790947137.070501:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1790947137.070516:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1790947137.070531:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1790947137.070546:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1790947137.070574:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1790947137.070590:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1790947137.072186:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1790947137.072241:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1790947137.072261:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1790947137.072276:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1790947137.072293:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1790947137.072591:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1790947137.072636:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1790947137.072653:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1790947137.073510:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1790947137.073538:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1790947137.073552:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1790947137.073565:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1790947137.073578:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1790947137.073591:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1790947137.073619:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1790947137.073635:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1790947137.073649:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1790947137.074296:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1790947137.074404:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1790947137.074437:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1790947137.074452:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1790947137.074466:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1790947137.074479:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1790947137.074491:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1790947137.074504:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1790947137.074515:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1790947137.074527:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1790947137.074540:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1790947137.074553:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1790947137.074565:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1790947137.074593:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1790947137.074623:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1790947137.074637:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1790947137.074650:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1790947137.075219:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1790947137.080805:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1790947137.080944:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1790947137.080974:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1790947137.080981:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1790947137.081261:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947137.083845:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.083915:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947137.086573:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593968896 00000100:00100000:0.0:1790947137.086589:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593968896 00000100:00100000:0.0:1790947137.086645:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790947137.086654:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593968896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947137.086871:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593968896:12345-0@lo:501:mount.lustre.0 Request processed in 203us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947137.086880:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790947137.087635:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593968896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947137.087686:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790947137.087742:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.087771:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969024 00000100:00100000:0.0:1790947137.087776:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969024 00000100:00100000:0.0:1790947137.087805:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790947137.087812:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790947137.087921:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969024:12345-0@lo:503:mount.lustre.0 Request processed in 108us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947137.087928:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790947137.087974:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947137.087986:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790947137.088439:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790947137.088504:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947137.088543:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.088581:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947137.088765:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969152 00000100:00100000:1.0:1790947137.088771:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969152 00000100:00100000:1.0:1790947137.088808:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790947137.088815:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947137.088926:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969152:12345-0@lo:502:mount.lustre.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947137.088934:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790947137.092531:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947137.093041:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1790947137.093076:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1790947137.093091:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1790947137.093106:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1790947137.093521:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1790947137.093545:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1790947137.093558:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1790947137.093568:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1790947137.093578:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1790947137.093588:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1790947137.093598:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1790947137.093608:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1790947137.093619:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1790947137.093630:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1790947137.093641:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1790947137.093651:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1790947137.093732:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1790947137.093755:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1790947137.093768:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1790947137.093778:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1790947137.093806:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1790947137.093818:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1790947137.093828:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1790947137.093841:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1790947137.093853:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1790947137.093890:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1790947137.093902:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1790947137.093915:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1790947137.093929:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1790947137.093944:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1790947137.093970:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1790947137.097535:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1790947137.097603:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1790947137.097620:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1790947137.097637:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1790947137.097654:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1790947137.097699:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1790947137.097717:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1790947137.097734:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1790947137.097752:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1790947137.097768:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1790947137.097785:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1790947137.097799:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1790947137.097817:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1790947137.097834:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1790947137.097852:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1790947137.097888:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1790947137.097907:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1790947137.097970:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947137.098169:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.098214:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969280 00000100:00100000:0.0:1790947137.098222:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969280 00000100:00100000:0.0:1790947137.098270:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790947137.098279:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947137.098518:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969280:12345-0@lo:502:mount.lustre.0 Request processed in 239us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947137.098526:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790947137.098579:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790947137.098601:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947137.098833:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1790947137.098884:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1790947137.098911:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947137.098951:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.098977:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790947137.113474:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969408 00000100:00100000:2.0:1790947137.113490:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969408 00000100:00100000:3.0:1790947137.113814:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790947137.113825:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947137.114031:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969408:12345-0@lo:502:mount.lustre.0 Request processed in 207us (15077us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947137.114039:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790947137.114119:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790947137.114434:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1790947137.114449:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790947137.116777:0:23504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790947137.116797:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff94b1ef2e99c0) 00000020:00000080:3.0:1790947137.116823:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790947137.118828:0:23504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b0c7116800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790947137.118836:0:23504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b0c7116800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790947137.118839:0:23504:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b0c7116800 3 00010000:00080000:3.0:1790947137.118883:0:23504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c7732000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1790947137.125243:0:23504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1790947137.126932:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790947137.126978:0:23504:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790947137.126992:0:23504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe6f6b79c2d6dec80 00000100:00080000:3.0:1790947137.127005:0:23504:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790947137.127016:0:23504:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94b0c7732000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947137.127051:0:23504:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e5180 x1877943593969536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947137.127080:0:23504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790947137.127106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947137.127110:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947137.127113:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947137.127116:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790947137.127505:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877943593969536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790947137.127571:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790947137.127810:0:23504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1790947137.128066:0:23484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790947137.128094:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790947137.128112:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec72 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.128123:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28800/0xe6f6b79c2d6dec6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec72 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790947137.128181:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790947137.128183:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790947137.128184:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947137.128186:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947137.128187:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947137.128188:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947137.128189:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790947137.128195:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947137.128197:0:23484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790947137.128200:0:23484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1790947137.128202:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790947137.128204:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790947137.128204:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947137.128205:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947137.128206:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947137.128207:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947137.128208:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790947137.128209:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947137.128210:0:23484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790947137.128230:0:23484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790947137.128243:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790947137.128283:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947137.128307:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d0318480 going to sleep for 11 seconds 00000100:00100000:0.0:1790947137.128504:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969664 00000100:00100000:0.0:1790947137.128512:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969664 00000100:00100000:0.0:1790947137.128551:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790947137.128560:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790947137.128586:0:22744:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790947137.128599:0:22744:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790947137.135369:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969536 00000100:00100000:2.0:1790947137.135386:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969536 00000100:00100000:2.0:1790947137.135446:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790947137.135456:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1877943593969536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790947137.135487:0:22752:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:2.0:1790947137.135549:0:22752:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe6f6b79c2d6dec87 00000004:00100000:2.0:1790947137.135567:0:22752:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790947137.135601:0:22752:0:(import.c:65:import_set_state_nolock()) ffff94b1fd0bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947137.135702:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877943593969536:12345-0@lo:38:llog_process_th.0 Request processed in 247us (8130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947137.135711:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790947137.135786:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94b0c84e5180 x1877943593969536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790947147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947137.135799:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790947137.135807:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790947137.135815:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790947137.135819:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790947137.135822:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7732000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790947137.135829:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877943593969536:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1790947137.138907:0:22732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1790947137.140387:0:22744:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790947137.140443:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790947137.149449:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:23484:x1877943593969664:12345-0@lo:253:mount.lustre.0 Request processed in 20882us (21157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947137.149467:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790947137.150822:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:23484:1877943593969664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790947137.150842:0:23484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790947137.150845:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790947137.150847:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790947137.150848:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947137.150850:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947137.150851:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947137.150852:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947137.150854:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790947137.150885:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947137.150887:0:23484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790947137.150906:0:23484:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1790947137.151930:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790947137.151935:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790947137.151954:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.151972:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.151991:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152000:0:22768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152036:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152050:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 17 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947137.152064:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593969792:0@lo:104: 00000100:00100000:0.0:1790947137.152140:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790947137.152197:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152207:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 17 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947137.152215:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593969920:0@lo:104: 00000100:00100000:0.0:1790947137.152236:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.152254:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c555bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790947137.152285:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969792 00000100:00100000:0.0:1790947137.152291:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969792 00000100:00100000:0.0:1790947137.152326:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593969920 00000100:00100000:0.0:1790947137.152330:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593969920 00000100:00100000:0.0:1790947137.152344:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790947137.152351:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:22768:x1877943593969792:12345-0@lo:104: 00010000:00010000:0.0:1790947137.152369:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152426:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790947137.152433:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:22768:x1877943593969792:12345-0@lo:104: Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947137.152440:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790947137.152456:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790947137.152462:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593969920:12345-0@lo:104: 00010000:00010000:0.0:1790947137.152469:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152500:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790947137.152505:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593969920:12345-0@lo:104: Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947137.152511:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790947137.152525:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947137.152531:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152538:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b800 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947137.152541:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152550:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947137.152559:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947137.152574:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790947137.152603:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152609:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947137.152626:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152633:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646b800/0xe6f6b79c2d6dec4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec56 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152644:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947137.152647:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.152653:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646bc00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947137.152656:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.153155:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947137.153259:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947137.153268:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947137.153273:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790947137.153294:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.153300:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947137.153326:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.153334:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646bc00/0xe6f6b79c2d6deb8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb92 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947137.153350:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947137.153352:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947137.153409:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947137.153443:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3640:1877943593970048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947137.153483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.153533:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593970176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947137.153554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947137.153592:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593969792:0@lo:104: 00000100:00100000:0.0:1790947137.153602:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593969920:0@lo:104: 00010000:00010000:0.0:1790947137.153620:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947137.155953:0:22738:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970048 00000100:00100000:1.0:1790947137.155966:0:22738:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970048 00010000:00010000:1.0:1790947137.155999:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 18 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947137.156085:0:22738:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970176 00000100:00100000:1.0:1790947137.156088:0:22738:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970176 00010000:00010000:1.0:1790947137.156101:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 19 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947137.156114:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790947137.156122:0:22738:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:3640:x1877943593970048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947137.156144:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947137.156149:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 19 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156159:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 19 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156176:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6dec56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec4f expref: 19 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156192:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790947137.156252:0:22738:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3640:x1877943593970048:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947137.156259:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790947137.156274:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790947137.156280:0:22738:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:3641:x1877943593970176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947137.156286:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947137.156290:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 17 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156298:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 17 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156314:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6deb92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb8b expref: 17 pid: 22747 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156325:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156333:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790947137.156347:0:22738:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004412575s 00010000:00010000:1.0:1790947137.156351:0:22738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156359:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156366:0:22738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156373:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156379:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947137.156383:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156391:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156403:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156428:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790947137.156456:0:22738:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:3641:x1877943593970176:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947137.156462:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790947137.156504:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593970176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790947137.156528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3640:1877943593970048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947137.156542:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156550:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947137.156557:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c646a000/0xe6f6b79c2d6dec8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1790947137.158823:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1790947137.159076:0:23509:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1790947137.159079:0:23509:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790947137.159247:0:23510:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1790947137.160045:0:23510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1790947137.161315:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1790947137.162143:0:23511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23511:1877943593970304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.162208:0:23511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947137.162246:0:23511:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340600 going to sleep for 11 seconds 00000040:01000000:0.0:1790947137.162527:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1790947137.162587:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790947137.163075:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970304 00000100:00100000:2.0:1790947137.163085:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970304 00000100:00100000:2.0:1790947137.163147:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790947137.163157:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23511:x1877943593970304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790947137.163248:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23511:x1877943593970304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947137.163264:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00000080:0.0:1790947137.163497:0:23484:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790947137.163505:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1790947137.163560:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790947137.164117:0:23511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23511:1877943593970304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1790947137.164159:0:23511:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790947137.164207:0:23511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23511:1877943593970432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.164254:0:23511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947137.164285:0:23511:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340600 going to sleep for 11 seconds 00000100:00100000:2.0:1790947137.164405:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970432 00000100:00100000:2.0:1790947137.164410:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970432 00000100:00100000:2.0:1790947137.164460:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790947137.164469:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23511:x1877943593970432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790947137.164576:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23511:x1877943593970432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947137.164583:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790947137.166958:0:23511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23511:1877943593970432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.167065:0:23511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23511:1877943593970560:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.167120:0:23511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947137.167258:0:22763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970560 00000100:00100000:3.0:1790947137.167264:0:22763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970560 00000100:00100000:3.0:1790947137.167301:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790947137.167309:0:22763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23511:x1877943593970560:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.167351:0:22763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23511:x1877943593970560:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947137.167358:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790947137.167380:0:23511:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340480 going to sleep for 11 seconds 00010000:00080000:3.0:1790947137.167393:0:23511:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94b0c84e7480 x1877943593970560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790947153 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947137.167404:0:23511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23511:1877943593970560:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.167456:0:23511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23511:1877943593970688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.167481:0:23511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947137.167502:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970688 00000100:00100000:3.0:1790947137.167505:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970688 00000100:00100000:3.0:1790947137.167526:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790947137.167532:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23511:x1877943593970688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790947137.167580:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23511:x1877943593970688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947137.167597:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790947137.167612:0:23511:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340600 going to sleep for 11 seconds 00000100:00100000:3.0:1790947137.167623:0:23511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23511:1877943593970688:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1790947137.167659:0:23511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947137.171153:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790947137.171236:0:23510:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1790947137.171830:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790947137.172410:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790947137.172462:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1790947137.172666:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790947137.173227:0:23484:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:3.0:1790947137.183527:0:23511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790947137.183599:0:23511:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790947137.183604:0:23511:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1790947137.184437:0:23484:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1790947137.206194:0:23484:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790947137.206241:0:23484:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaf9081c77988 00100000:10000000:0.0:1790947137.206250:0:23484:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790947137.211467:0:23484:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790947137.211504:0:23484:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790947137.211529:0:23484:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790947137.211555:0:23484:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790947137.212440:0:23484:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790947137.212662:0:23484:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790947137.358501:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947137.746012:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000040:00080000:1.0:1790947138.192447:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790947138.387153:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947138.767049:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 10000000:01000000:0.0:1790947138.893945:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790947138.893953:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b0c7116800 from 12 10000000:01000000:0.0:1790947138.893958:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947138.894003:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.894015:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.894027:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947138.894052:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593970816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947138.894111:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947138.894155:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d79d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947138.894225:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970816 00000100:00100000:1.0:1790947138.894235:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970816 00000100:00100000:1.0:1790947138.894287:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790947138.894296:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:22749:x1877943593970816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790947138.894320:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947138.894333:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dec95 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947138.894355:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947138.894365:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947138.894373:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cec00, rc 0) 00000100:00100000:1.0:1790947138.894427:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593970816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947138.894434:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790947138.894537:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593970816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790947138.894552:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.894561:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947138.894609:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593970944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790947138.894653:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947138.894676:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d79d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947138.894732:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593970944 00000100:00100000:1.0:1790947138.894737:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593970944 00000100:00100000:1.0:1790947138.894767:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790947138.894774:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593970944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790947138.894787:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790947138.894802:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790947138.894805:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1790947138.894915:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593970944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947138.894922:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790947138.895172:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593970944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790947138.895217:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790947138.895225:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.895234:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947138.895243:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790947138.895246:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b1fcde2000 from 12 10000000:01000000:0.0:1790947138.895249:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947138.895267:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.895274:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.895282:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947138.895296:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593971072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947138.895322:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947138.895351:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d79d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947138.895397:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971072 00000100:00100000:1.0:1790947138.895411:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971072 00000100:00100000:1.0:1790947138.895444:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790947138.895450:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593971072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790947138.895468:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947138.895477:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deca3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947138.895492:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947138.895501:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947138.895508:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cea00, rc 0) 00000100:00100000:1.0:1790947138.895547:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593971072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947138.895554:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790947138.895801:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593971072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790947138.895814:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947138.895822:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947138.895906:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593971200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790947138.895936:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947138.895958:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d79d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947138.896219:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971200 00000100:00100000:1.0:1790947138.896224:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971200 00000100:00100000:1.0:1790947138.896257:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790947138.896264:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593971200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790947138.896277:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790947138.896291:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790947138.896294:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1790947138.896371:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593971200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947138.896379:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790947138.896608:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593971200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790947138.896659:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790947138.896666:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947138.896674:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790947139.218552:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790947139.406151:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947139.790443:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790947140.431259:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947140.821180:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1790947141.472249:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947141.838151:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1790947142.352223:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790947142.352244:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593971328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790947142.352323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947142.352396:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971328 00000100:00100000:1.0:1790947142.352404:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971328 00000100:00100000:1.0:1790947142.352447:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947142.352456:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593971328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947142.352489:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790947142.352545:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593971328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947142.352552:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947142.352604:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593971328:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1790947142.353328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790947142.353333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790947142.353336:0:36:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790947142.353347:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94b0c5ac4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947142.353368:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e75880 x1877943593971584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790947142.353395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947142.353398:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790947142.353401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947142.353403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790947142.353415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947142.353418:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790947142.353421:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947142.353423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790947142.353451:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593971456:0@lo:400:kworker.0 00000100:00100000:0.0:1790947142.353514:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947142.353544:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790947142.353550:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593971712:0@lo:400:kworker.0 00000100:00100000:0.0:1790947142.353574:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947142.353598:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971712 00000100:00100000:0.0:1790947142.353603:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971712 00000100:00100000:0.0:1790947142.353636:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790947142.353643:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593971712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947142.353680:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593971712:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947142.353687:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790947142.353705:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947142.353712:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593971840:0@lo:400:kworker.0 00000100:00100000:0.0:1790947142.353733:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790947142.353765:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7e77480 x1877943593971712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947142.353776:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593971712:0@lo:400:kworker.0 00000100:00100000:2.0:1790947142.354949:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971456 00000100:00100000:2.0:1790947142.354957:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971456 00000100:00100000:2.0:1790947142.355028:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790947142.355037:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3639:x1877943593971456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947142.355152:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3639:x1877943593971456:12345-0@lo:400:kworker.0 Request processed in 116us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947142.355158:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790947142.356975:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971840 00000100:00100000:3.0:1790947142.356987:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971840 00000100:00100000:3.0:1790947142.357044:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790947142.357053:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593971840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947142.357136:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593971840:12345-0@lo:400:kworker.0 Request processed in 84us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947142.357143:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790947142.358680:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593971456:0@lo:400:kworker.0 00010000:00080000:0.0:1790947142.358726:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7e77800 x1877943593971840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947142.358738:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593971840:0@lo:400:kworker.0 00000100:00100000:2.0:1790947142.368545:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593971584:0@lo:38:kworker.0 00000100:00100000:2.0:1790947142.368621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947142.368699:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971584 00000100:00100000:2.0:1790947142.368707:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971584 00000100:00100000:2.0:1790947142.368740:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790947142.368747:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1877943593971584:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790947142.368784:0:23493:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:2.0:1790947142.368819:0:23493:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6decb1 00000004:00100000:2.0:1790947142.368836:0:23493:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790947142.368841:0:23493:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:02000400:3.0:1790947142.382207:0:23754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1790947142.391423:0:23493:0:(import.c:65:import_set_state_nolock()) ffff94b1c31d9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790947142.391621:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877943593971584:12345-0@lo:38:kworker.0 Request processed in 22871us (22998us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947142.391632:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790947142.393894:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790947142.393909:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790947142.393915:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790947142.393918:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ac4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790947142.393947:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000af0e4f00): req@ffff94b1c2eb1c00 x1877943593964416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947142.393971:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593971584:0@lo:38:kworker.0 00000100:00100000:1.0:1790947142.394051:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790947142.394067:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593971968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790947142.394235:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947142.394265:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947142.394475:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593964416 00000100:00100000:0.0:1790947142.394481:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593964416 00000100:00100000:0.0:1790947142.394601:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790947142.394609:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22794:x1877943593964416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790947142.394683:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22794:x1877943593964416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947142.394690:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790947142.394720:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1877943593964416:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1790947142.394749:0:22794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790947142.394778:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1877943593972096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790947142.395051:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947142.395126:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8540 going to sleep for 11 seconds 00000100:00100000:1.0:1790947142.395418:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972096 00000100:00100000:1.0:1790947142.395424:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972096 00000100:00100000:1.0:1790947142.395460:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790947142.395468:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22794:x1877943593972096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790947142.395579:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22794:x1877943593972096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947142.395585:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790947142.395588:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1877943593972096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790947142.395664:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1877943593972224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790947142.395689:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947142.395715:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790947142.395745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947142.395814:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972224 00000100:00100000:1.0:1790947142.395819:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972224 00000100:00100000:1.0:1790947142.395893:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593971968 00000100:00100000:1.0:1790947142.395897:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593971968 00000100:00100000:2.0:1790947142.395961:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790947142.395970:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22794:x1877943593972224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790947142.395984:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947142.395992:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1877943593971968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790947142.396015:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790947142.396023:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22794:x1877943593972224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947142.396029:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790947142.396051:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1877943593972224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790947142.396053:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877943593971968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947142.396059:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:2.0:1790947142.396087:0:22794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790947142.399009:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790947142.399094:0:22794:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1790947142.399101:0:22794:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1790947142.399228:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593971968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790947142.478267:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790947143.456921:0:23806:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790947143.457124:0:23806:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790947143.502142:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947144.526923:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790947144.541698:0:23857:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790947144.541942:0:23857:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1790947144.846528:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790947145.550035:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790947145.766342:0:23905:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe3555eb0 20000000:00000080:3.0:1790947145.766367:0:23905:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94b1ee5bd400 uarg=0000000000000000 20000000:01000000:3.0:1790947145.766410:0:23905:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790947145.766417:0:23905:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790947145.766421:0:23905:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790947145.773708:0:23906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1790947145.775546:0:23905:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790947145.796660:0:23905:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790947145.796716:0:23905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.796736:0:23905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.796745:0:23905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.796769:0:23905:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.797213:0:23905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.797231:0:23905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 17 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947145.797246:0:23905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1877943593972352:0@lo:104: 00000100:00100000:0.0:1790947145.797307:0:23905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790947145.797376:0:23905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.797384:0:23905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 17 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947145.797389:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972352 00000100:00100000:0.0:1790947145.797392:0:23905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1877943593972480:0@lo:104: 00000100:00100000:3.0:1790947145.797397:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972352 00000100:00100000:0.0:1790947145.797412:0:23905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947145.797438:0:23905:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947145.798104:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972480 00000100:00100000:3.0:1790947145.798112:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972480 00000100:00100000:3.0:1790947145.798138:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790947145.798147:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:23905:x1877943593972352:12345-0@lo:104: 00010000:00010000:3.0:1790947145.798160:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799484:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790947145.799495:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:23905:x1877943593972352:12345-0@lo:104: Request processed in 1347us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947145.799504:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790947145.799507:0:23905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1877943593972352:0@lo:104: 00000100:00100000:3.0:1790947145.799543:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790947145.799554:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:23905:x1877943593972480:12345-0@lo:104: 00010000:00010000:3.0:1790947145.799567:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799618:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790947145.799623:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:23905:x1877943593972480:12345-0@lo:104: Request processed in 74us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947145.799629:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790947145.799645:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947145.799651:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799657:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29400 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947145.799662:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799670:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947145.799676:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947145.799682:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790947145.799713:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799720:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790947145.799734:0:23905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1877943593972480:0@lo:104: 00010000:00010000:3.0:1790947145.799740:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799757:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29400/0xe6f6b79c2d6dec5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec64 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.799757:0:23905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799770:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947145.799773:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799779:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29c00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947145.799782:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799789:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947145.799795:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947145.799800:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790947145.799816:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799821:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790947145.799828:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799834:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29c00/0xe6f6b79c2d6deb5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6deb61 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.799846:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947145.799853:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947145.799855:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947145.799905:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593972608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790947145.799940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947145.799973:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790947145.799978:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593972736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790947145.799999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947145.800035:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972608 00000100:00100000:0.0:1790947145.800036:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972736 00000100:00100000:3.0:1790947145.800041:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972608 00000100:00100000:0.0:1790947145.800041:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972736 00010000:00010000:0.0:1790947145.800076:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 19 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947145.800109:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790947145.800116:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:3639:x1877943593972736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947145.800127:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947145.800132:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 19 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.800141:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 19 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.800155:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cfe00/0xe6f6b79c2d6deb61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6deb5a expref: 19 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947145.800168:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947145.800197:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3639:x1877943593972736:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947145.800204:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790947145.800249:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 18 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947145.800263:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790947145.800271:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3639:x1877943593972608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790947145.800278:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947145.800282:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 18 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800291:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 18 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800300:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cfa00/0xe6f6b79c2d6dec64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec5d expref: 18 pid: 22746 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800312:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800320:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800343:0:22739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800410:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800419:0:22739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800425:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800431:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947145.800434:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800442:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800463:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947145.800472:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947145.800499:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:3639:x1877943593972608:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947145.800506:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790947145.800531:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593972736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790947145.800538:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593972608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947145.802562:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947145.802754:0:23905:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947145.802776:0:23905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947145.802783:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c646b600/0xe6f6b79c2d6decb8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947146.461473:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947136/real 1790947136] req@ffff94b1c2eb2300 x1877943593967744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947146.461511:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b1c2eb2300 x1877943593967744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947146.461523:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947136/real 1790947136] req@ffff94b1c2eb1f80 x1877943593967488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947146.461549:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b1c2eb1f80 x1877943593967488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790947146.462013:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947146.462054:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1790947146.462259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947146.462264:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947146.462266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947146.462269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947146.462289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947146.462291:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947146.462294:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947146.462297:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790947146.462300:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947146.462305:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:2.0:1790947146.462311:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790947146.462322:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947146.462343:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c80380 x1877943593973376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790947146.462388:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593972992:0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.462445:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947146.462479:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790947146.462495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3642:1877943593972864:0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.462525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947146.462577:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593973504:0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.462607:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947146.462649:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972992 00000100:00100000:2.0:1790947146.462656:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972992 00000100:00100000:2.0:1790947146.462700:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790947146.462711:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1877943593972992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947146.462726:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593973504 00000100:00100000:1.0:1790947146.462730:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593973504 00000100:00100000:1.0:1790947146.462757:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790947146.462762:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1877943593972992:12345-0@lo:400:kworker.0 Request processed in 54us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947146.462764:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593973504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.462769:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790947146.462789:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593972864 00000100:00100000:2.0:1790947146.462792:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593972864 00000100:00100000:1.0:1790947146.462795:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593973504:12345-0@lo:400:kworker.0 Request processed in 32us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947146.462801:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790947146.462815:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790947146.462821:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:3642:x1877943593972864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.462851:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:3642:x1877943593972864:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947146.462882:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790947146.462923:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3642:1877943593972864:0@lo:400:kworker.0 00010000:00080000:2.0:1790947146.462935:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7c82680 x1877943593973504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947146.462945:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593973504:0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.462953:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593972992:0@lo:400:kworker.0 00000100:00100000:3.0:1790947146.463506:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593973120:0@lo:400:kworker.0 00000100:00100000:3.0:1790947146.463569:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947146.463600:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790947146.463607:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593973248:0@lo:400:kworker.0 00000100:00100000:3.0:1790947146.463628:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947146.463656:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593973120 00000100:00100000:3.0:1790947146.463660:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593973120 00000100:00100000:3.0:1790947146.463689:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790947146.463697:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593973120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947146.463736:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593973120:12345-0@lo:400:kworker.0 Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947146.463741:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790947146.463768:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7c80000 x1877943593973120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947146.463778:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593973120:0@lo:400:kworker.0 00000100:00100000:0.0:1790947146.463941:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593967744:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790947146.463951:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947146.463967:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947146.463972:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593967488:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1790947146.464003:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593973376:0@lo:8:kworker.0 00000400:00000100:0.0:1790947146.464025:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593973376 offset 0 length 520: 4 00000100:00100000:2.0:1790947146.464316:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593973248 00000100:00100000:2.0:1790947146.464322:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593973248 00000100:00100000:2.0:1790947146.464367:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790947146.464374:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593973248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.464416:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593973248:12345-0@lo:400:kworker.0 Request processed in 43us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947146.464422:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1790947146.464489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947146.464495:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947146.464498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947146.464501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947146.464504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947146.464507:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790947146.464510:0:36:0:(import.c:65:import_set_state_nolock()) ffff94b0c774c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947146.464515:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1790947146.464519:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790947146.464526:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94b0c774c800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947146.464707:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c84e7100 x1877943593973632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947146.464761:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593973248:0@lo:400:kworker.0 00000100:00100000:2.0:1790947146.464807:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593973632:0@lo:8:kworker.0 00000400:00000100:2.0:1790947146.464832:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593973632 offset 0 length 520: 4 00010000:00010000:3.0:1790947146.575519:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790947147.277932:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790947147.277940:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b0c7116800 from 13 10000000:01000000:3.0:1790947147.277945:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790947147.277998:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947147.278011:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947147.278021:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947147.278046:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593973760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790947147.278111:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947147.278162:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c372b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947147.278227:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593973760 00000100:00100000:2.0:1790947147.278235:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593973760 00000100:00100000:2.0:1790947147.278303:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790947147.278312:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+16:22749:x1877943593973760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947147.278324:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947147.278338:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6decbf expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.278370:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.278380:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.278389:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223600, rc 0) 00000100:00100000:2.0:1790947147.278439:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593973760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947147.278446:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790947147.278527:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593973760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947147.278541:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947147.278549:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947147.278618:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593973888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790947147.278646:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947147.278756:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c372b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947147.279477:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593973888 00000100:00100000:2.0:1790947147.279483:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593973888 00000100:00100000:2.0:1790947147.279525:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790947147.279542:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593973888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790947147.279887:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593973888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947147.279896:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790947147.280892:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593973888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790947147.280948:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790947147.281007:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947147.281048:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c372b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947147.281101:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593974016 00000100:00100000:2.0:1790947147.281107:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593974016 00000100:00100000:2.0:1790947147.281153:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790947147.281162:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593974016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790947147.281280:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593974016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947147.281287:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790947147.281465:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790947147.282449:0:23966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790947147.285944:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790947147.285984:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790947147.285996:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947147.286009:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947147.286021:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790947147.286024:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1fcde2000 from 13 10000000:01000000:0.0:1790947147.286026:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790947147.286063:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947147.286071:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947147.286081:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947147.286127:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947147.286194:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947147.286243:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947147.286313:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593974144 00000100:00100000:2.0:1790947147.286320:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593974144 00000100:00100000:2.0:1790947147.286379:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790947147.286389:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+17:22749:x1877943593974144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947147.286401:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947147.286413:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deccd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.286436:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.286446:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.286454:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222600, rc 0) 00000100:00100000:2.0:1790947147.286502:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593974144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947147.286515:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790947147.286693:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790947147.286707:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947147.286716:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947147.286772:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790947147.286798:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947147.286819:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947147.286889:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593974272 00000100:00100000:3.0:1790947147.286894:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593974272 00000100:00100000:3.0:1790947147.286926:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790947147.286932:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593974272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790947147.287033:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593974272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947147.287039:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790947147.287103:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790947147.287127:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790947147.287161:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947147.287184:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947147.287228:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593974400 00000100:00100000:2.0:1790947147.287232:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593974400 00000100:00100000:2.0:1790947147.287291:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790947147.287297:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593974400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790947147.287373:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:22749:x1877943593974400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947147.287379:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790947147.287649:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593974400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790947147.288836:0:23967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790947147.289046:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790947147.289068:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790947147.289079:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947147.289090:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947147.471228:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593974528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790947147.471294:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947147.471364:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593974528 00000100:00100000:3.0:1790947147.471371:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593974528 00000100:00100000:3.0:1790947147.471424:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790947147.471433:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593974528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790947147.471470:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790947147.471534:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593974528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947147.471540:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790947147.471584:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593974528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947147.474081:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947132/real 1790947132] req@ffff94b0c84e6d80 x1877943593965568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947147 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947147.474110:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c84e6d80 x1877943593965568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947147 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947147.474120:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947132/real 1790947132] req@ffff94b0c84e7b80 x1877943593965696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947147 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947147.474144:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c84e7b80 x1877943593965696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947147 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790947147.474162:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947147.474180:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947147.474185:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593965568:0@lo:8:kworker.0 00000100:00080000:0.0:1790947147.474191:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947147.474195:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947147.474198:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593965696:0@lo:8:kworker.0 00000100:00080000:0.0:1790947147.474260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947147.474264:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790947147.474267:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790947147.474271:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:0.0:1790947147.474276:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790947147.474286:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94b0c7ea3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947147.474305:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e75f80 x1877943593974784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790947147.474319:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947147.474322:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790947147.474323:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790947147.474327:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:0.0:1790947147.474329:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790947147.474334:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94b0c774b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1790947147.474414:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e76680 x1877943593974912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790947147.474439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947147.474443:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790947147.474445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790947147.474448:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790947147.474478:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593974784:0@lo:8:kworker.0 00000400:00000100:0.0:1790947147.474527:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593974784 offset 0 length 520: 4 00000100:00100000:0.0:1790947147.474560:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593974912:0@lo:8:kworker.0 00000400:00000100:0.0:1790947147.474575:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943593974912 offset 0 length 520: 4 00000100:00100000:3.0:1790947147.475354:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593974656:0@lo:400:kworker.0 00000100:00100000:3.0:1790947147.475414:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947147.475442:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593974656 00000100:00100000:3.0:1790947147.475447:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790947147.475452:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593974656 00000100:00100000:3.0:1790947147.475456:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593975040:0@lo:400:kworker.0 00000100:00100000:3.0:1790947147.475487:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947147.475514:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790947147.475526:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975040 00000100:00100000:0.0:1790947147.475527:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877943593974656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947147.475533:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975040 00000100:00100000:3.0:1790947147.475567:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790947147.475574:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593975040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947147.475597:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877943593974656:12345-0@lo:400:kworker.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947147.475606:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790947147.475615:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593975040:12345-0@lo:400:kworker.0 Request processed in 41us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947147.475623:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790947147.475650:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593975168:0@lo:400:kworker.0 00000100:00100000:3.0:1790947147.475674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947147.475701:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947147.475706:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593975296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947147.475724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947147.475747:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975296 00000100:00100000:3.0:1790947147.475750:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975296 00000100:00100000:3.0:1790947147.475772:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790947147.475779:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877943593975296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790947147.475802:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790947147.475838:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877943593975296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947147.475838:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975168 00000100:00100000:0.0:1790947147.475845:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975168 00000100:00100000:3.0:1790947147.475850:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790947147.475900:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790947147.475908:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593975168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947147.475919:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593975296:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1790947147.475963:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7e75880 x1877943593975040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947147.475965:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593975168:12345-0@lo:400:kworker.0 Request processed in 56us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947147.475974:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790947147.475989:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7f08e00 x1877943593975168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947147.475990:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593975040:0@lo:400:kworker.0 00000100:00100000:1.0:1790947147.476006:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593975168:0@lo:400:kworker.0 00000100:00100000:3.0:1790947147.476012:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593974656:0@lo:400:kworker.0 00010000:00010000:1.0:1790947147.598677:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790947147.983135:0:23485:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1790947148.623148:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947149.456246:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790947149.646004:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947150.671490:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947151.700192:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790947152.592543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947152.592550:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947152.592552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947152.592555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947152.592578:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947152.592581:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947152.592584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947152.592587:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790947152.593517:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877943593975680:0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.593586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947152.593677:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790947152.593685:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593975808:0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.593713:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947152.597095:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593975424:0@lo:400:kworker.0 00000100:00100000:3.0:1790947152.597170:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947152.597213:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943593975936:0@lo:400:kworker.0 00000100:00100000:3.0:1790947152.597244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947152.599110:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790947152.599128:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593975552:0@lo:400:kworker.0 00000100:00100000:3.0:1790947152.599176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947152.599203:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593976064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947152.599223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947152.599259:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975808 00000100:00100000:3.0:1790947152.599267:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975808 00000100:00100000:3.0:1790947152.599314:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975552 00000100:00100000:3.0:1790947152.599317:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975552 00000100:00100000:3.0:1790947152.599330:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976064 00000100:00100000:3.0:1790947152.599333:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976064 00000100:00100000:3.0:1790947152.599345:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790947152.599354:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593975808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.599523:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790947152.599534:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1877943593975552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.599585:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1877943593975552:12345-0@lo:400:kworker.0 Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947152.599591:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790947152.599609:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790947152.599615:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593976064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790947152.599640:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790947152.599672:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593976064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947152.599678:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790947152.599752:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593975808:12345-0@lo:400:kworker.0 Request processed in 399us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947152.599759:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790947152.599808:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975424 00000100:00100000:3.0:1790947152.599824:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975424 00000100:00100000:3.0:1790947152.599876:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790947152.599894:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3639:x1877943593975424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947152.599927:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:3639:x1877943593975424:12345-0@lo:400:kworker.0 Request processed in 45us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947152.599932:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790947152.599977:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593975552:0@lo:400:kworker.0 00000100:00100000:3.0:1790947152.599991:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593976064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947152.599999:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593975424:0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.600106:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593976192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790947152.600138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947152.600161:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593975808:0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.600181:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976192 00000100:00100000:1.0:1790947152.600184:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976192 00000100:00100000:1.0:1790947152.600207:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790947152.600213:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593976192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947152.600229:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790947152.600261:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593976192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947152.600273:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790947152.600314:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593976192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790947152.600538:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975680 00000100:00100000:2.0:1790947152.600543:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975680 00000100:00100000:2.0:1790947152.600612:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593975936 00000100:00100000:2.0:1790947152.600616:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593975936 00000100:00100000:1.0:1790947152.600656:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790947152.600664:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877943593975680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947152.600761:0:22753:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790947152.600770:0:22753:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790947152.600813:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877943593975680:12345-0@lo:400:kworker.0 Request processed in 150us (7227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947152.600820:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790947152.600834:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947152.600840:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877943593975936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947152.600912:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877943593975936:12345-0@lo:400:kworker.0 Request processed in 71us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947152.600919:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1790947152.601122:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b1c2eb1500 x1877943593975936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947152.601132:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943593975936:0@lo:400:kworker.0 00010000:00080000:3.0:1790947152.601906:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b1c2eb3480 x1877943593975680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947152.601919:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877943593975680:0@lo:400:kworker.0 00010000:00010000:0.0:1790947152.719340:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790947152.972269:0:24254:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790947152.972273:0:24254:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790947152.972275:0:24254:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790947152.972402:0:24254:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94b1fcd76000 00000020:01000004:0.0:1790947152.972418:0:24254:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790947152.972431:0:24254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790947152.972444:0:24254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94b0c86119c0) 00000020:00000080:0.0:1790947152.972461:0:24254:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790947153.062192:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790947153.063651:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790947153.063994:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790947153.064526:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790947153.064984:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790947153.065335:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790947153.065511:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1790947153.069532:0:24254:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790947153.069823:0:24254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790947153.069836:0:24254:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790947153.069849:0:24254:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6f6b79c2d6dece2 00000020:01000004:2.0:1790947153.070810:0:24254:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790947153.070847:0:24254:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790947153.070851:0:24254:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790947153.070893:0:24254:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790947153.070899:0:24254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790947153.070914:0:24254:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94b1fd2a99c0) 00000020:00000080:2.0:1790947153.070931:0:24254:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790947153.072117:0:24254:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947153.072277:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790947153.072283:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790947153.082991:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790947153.083016:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790947153.084629:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790947153.084640:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790947153.093211:0:24254:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790947153.093519:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790947153.093609:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790947153.095502:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790947153.095515:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790947153.113609:0:24254:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790947153.113956:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790947153.113963:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790947153.115838:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790947153.115851:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790947153.118127:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790947153.118138:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790947153.126291:0:24254:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790947153.126499:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790947153.126506:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790947153.128703:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790947153.128716:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1790947153.192656:0:24254:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790947153.192902:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790947153.192909:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790947153.194044:0:24254:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790947153.194052:0:24254:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790947153.194482:0:24254:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790947153.194510:0:24254:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1790947153.194515:0:24254:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790947153.208506:0:24254:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790947153.208550:0:24254:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1790947153.208555:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790947153.208562:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790947153.208563:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790947153.208564:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790947153.208565:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790947153.208566:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790947153.208568:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790947153.208569:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790947153.208570:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790947153.208574:0:24254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1790947153.208576:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790947153.208577:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790947153.208578:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790947153.208579:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790947153.208579:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790947153.208580:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790947153.208581:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790947153.208582:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790947153.208583:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790947153.208607:0:24254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790947153.208626:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790947153.208700:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947153.208737:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206600 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.209241:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976320 00000100:00100000:3.0:1790947153.209250:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976320 00000100:00100000:3.0:1790947153.209310:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790947153.209320:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:24254:x1877943593976320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790947153.209360:0:22747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790947153.209364:0:22747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1790947153.209368:0:22747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790947153.210923:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:24254:x1877943593976320:12345-0@lo:253:mount.lustre.0 Request processed in 1599us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.210935:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790947153.211180:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790947153.211193:0:24254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790947153.211196:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790947153.211198:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790947153.211199:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790947153.211200:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790947153.211201:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790947153.211203:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790947153.211204:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790947153.211206:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790947153.211207:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790947153.211234:0:24254:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94b1fcd76000 from lustre-OST0000 10000000:01000000:0.0:1790947153.211264:0:24254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790947153.211267:0:24254:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790947153.211275:0:24254:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94b1fd358000 local copy 00010000:00010000:0.0:1790947153.211305:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947153.211401:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947153.211438:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.213930:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206540 going to sleep for 11 seconds 00000100:00100000:2.0:1790947153.214588:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976448 00000100:00100000:2.0:1790947153.214597:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976448 00000100:00100000:2.0:1790947153.214654:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790947153.214662:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:24254:x1877943593976448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947153.214824:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:24254:x1877943593976448:12345-0@lo:501:mount.lustre.0 Request processed in 162us (3390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790947153.214832:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790947153.218156:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976448:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790947153.218200:0:24254:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790947153.218355:0:24254:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790947153.218365:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.218389:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947153.218423:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94b1fcd76000 10000000:01000000:1.0:1790947153.218427:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790947153.218432:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790947153.218435:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790947153.218439:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790947153.218442:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790947153.218471:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.218479:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.218490:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947153.218508:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790947153.218560:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.218691:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d79d6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.218788:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976576 00000100:00100000:3.0:1790947153.218801:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976576 00000100:00100000:3.0:1790947153.219083:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790947153.219093:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+18:24254:x1877943593976576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947153.219106:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947153.219117:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1f6c29c00/0xe6f6b79c2d6decf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6decf0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.219139:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c29c00/0xe6f6b79c2d6decf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6decf0 expref: 19 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.219149:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1f6c29c00/0xe6f6b79c2d6decf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6decf0 expref: 19 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.219158:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c29c00, rc 0) 00000100:00100000:3.0:1790947153.219338:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976576:12345-0@lo:101:mount.lustre.0 Request processed in 246us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.219346:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790947153.219485:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947153.219500:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decf7 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.219509:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6decf7 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790947153.220750:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1790947153.221787:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947153.224785:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790947153.224840:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1790947153.224854:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1790947153.225112:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1790947153.225126:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1790947153.225137:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1790947153.225148:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1790947153.225158:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1790947153.225169:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1790947153.225180:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1790947153.225191:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1790947153.225201:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1790947153.225413:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1790947153.225421:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1790947153.225542:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947153.225599:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.225689:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1790947153.225783:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976704 00000100:00100000:0.0:1790947153.225790:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976704 00000100:00100000:0.0:1790947153.225967:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790947153.225978:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947153.226123:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976704:12345-0@lo:501:mount.lustre.0 Request processed in 147us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947153.226130:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790947153.226347:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947153.226382:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947153.226427:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947153.226679:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790947153.226785:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976832 00000100:00100000:2.0:1790947153.226790:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976832 00000100:00100000:2.0:1790947153.226814:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790947153.226820:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790947153.227597:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976832:12345-0@lo:503:mount.lustre.0 Request processed in 773us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947153.227608:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790947153.227786:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790947153.228440:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790947153.228530:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947153.228577:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947153.228603:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790947153.228764:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593976960 00000100:00100000:2.0:1790947153.228769:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593976960 00000100:00100000:2.0:1790947153.228796:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790947153.228802:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.229434:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593976960:12345-0@lo:502:mount.lustre.0 Request processed in 629us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947153.229442:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790947153.229626:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593976960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790947153.230459:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790947153.230497:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1790947153.230511:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1790947153.230523:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1790947153.230534:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1790947153.230545:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1790947153.230558:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1790947153.230573:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1790947153.230587:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1790947153.230600:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1790947153.230614:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1790947153.230629:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1790947153.233194:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947153.233316:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947153.233363:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790947153.233490:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977088 00000100:00100000:2.0:1790947153.233499:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977088 00000100:00100000:2.0:1790947153.233544:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790947153.233553:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593977088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.233753:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593977088:12345-0@lo:502:mount.lustre.0 Request processed in 200us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947153.233762:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790947153.234220:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790947153.234331:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1790947153.234347:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1790947153.237381:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790947153.237391:0:24271:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1790947153.237398:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.237401:0:24271:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790947153.237408:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790947153.237424:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94b1ef2eb380) 00000020:00000080:3.0:1790947153.237447:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790947153.237453:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790947153.237551:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1fcd76000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790947153.237560:0:24271:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790947153.237566:0:24271:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6f6b79c2d6ded05 00010000:00010000:3.0:1790947153.242426:0:24271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1790947153.243382:0:24271:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1790947153.244750:0:24271:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1790947153.246607:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790947153.246618:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947153.246625:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.246627:0:24271:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790947153.246630:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790947153.246633:0:24271:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1790947153.246634:0:24271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790947153.246636:0:24271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790947153.246637:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790947153.246639:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.246641:0:24271:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790947153.246643:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947153.246646:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.246647:0:24271:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790947153.246649:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790947153.246652:0:24271:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790947153.246654:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947153.246656:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.246657:0:24271:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790947153.246660:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947153.246662:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.246663:0:24271:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790947153.246678:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790947153.246705:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947153.246708:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947153.246709:0:24271:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790947153.246713:0:24271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1790947153.246984:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1790947153.247028:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790947153.247051:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decf7 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.247062:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfe00/0xe6f6b79c2d6decf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6decf7 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947153.247071:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1fcd76000 from 1 10000000:01000000:1.0:1790947153.247074:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790947153.247119:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.247127:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.247138:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947153.247160:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790947153.247226:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.247271:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.247410:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977216 00000100:00100000:3.0:1790947153.247418:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977216 00000100:00100000:3.0:1790947153.247469:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790947153.247479:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:24254:x1877943593977216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947153.247502:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947153.247514:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6ded0c expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.247535:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 20 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.247547:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 20 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.247555:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c28e00, rc 0) 00000100:00100000:3.0:1790947153.247594:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977216:12345-0@lo:101:mount.lustre.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.247602:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790947153.247851:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947153.247906:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.247916:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790947153.249428:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790947153.249777:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947153.250213:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790947153.250241:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790947153.250257:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790947153.250271:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790947153.250285:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790947153.250309:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790947153.250325:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790947153.250340:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790947153.250353:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790947153.250365:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790947153.250391:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790947153.250410:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790947153.250415:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790947153.250492:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947153.250551:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.250593:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.250760:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977344 00000100:00100000:3.0:1790947153.250767:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977344 00000100:00100000:3.0:1790947153.250806:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790947153.250813:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947153.251050:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947153.251083:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790947153.251120:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947153.251139:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1e1d99480 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.251274:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977344:12345-0@lo:501:mount.lustre.0 Request processed in 138us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.251284:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790947153.251319:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977472 00000100:00100000:3.0:1790947153.251323:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977472 00000100:00100000:3.0:1790947153.251337:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790947153.251343:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947153.251423:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977472:12345-0@lo:503:mount.lustre.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.251440:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790947153.251510:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790947153.252829:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790947153.253095:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.253163:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947153.253199:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1e1d99480 going to sleep for 11 seconds 00000100:00100000:1.0:1790947153.253323:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977600 00000100:00100000:1.0:1790947153.253331:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977600 00000100:00100000:1.0:1790947153.254692:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790947153.254710:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947153.254883:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977600:12345-0@lo:502:mount.lustre.0 Request processed in 179us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.254891:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790947153.255408:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947153.255682:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790947153.255715:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790947153.255731:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790947153.255746:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790947153.255759:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790947153.255773:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790947153.255786:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790947153.255800:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790947153.255815:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790947153.255830:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790947153.255844:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790947153.255909:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.255979:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947153.261519:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1e1d99480 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.261596:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977728 00000100:00100000:3.0:1790947153.261607:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977728 00000100:00100000:3.0:1790947153.261650:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790947153.261660:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947153.262408:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977728:12345-0@lo:502:mount.lustre.0 Request processed in 745us (6424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.262418:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790947153.263754:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947153.264178:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790947153.264195:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790947153.271446:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947153.271461:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.271463:0:24275:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790947153.271472:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b1fcd76000 00000020:00000080:0.0:1790947153.271475:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947153.271482:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947153.271485:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.271486:0:24275:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790947153.271489:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947153.271492:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.271493:0:24275:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790947153.271496:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b1fcd76000 00000020:00000080:0.0:1790947153.271498:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947153.271602:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947153.271606:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.271608:0:24275:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790947153.271610:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947153.271613:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.271619:0:24275:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790947153.271624:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b1fcd76000 00000020:00000080:0.0:1790947153.271626:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947153.272936:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947153.272947:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.273002:0:24275:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790947153.273072:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790947153.273078:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.273079:0:24275:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790947153.273084:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b1fcd76000 00000020:00000080:0.0:1790947153.273086:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790947153.273135:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790947153.273138:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790947153.273139:0:24275:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790947153.273142:0:24275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1790947153.281939:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790947153.281999:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790947153.282029:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282041:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947153.282098:0:24254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790947153.282102:0:24254:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94b1fcd76000 10000000:01000000:1.0:1790947153.282105:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94b1fcd76000 10000000:01000000:1.0:1790947153.282108:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790947153.282115:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94b1fcd76000 from 1 10000000:01000000:1.0:1790947153.282117:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790947153.282153:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282172:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282183:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947153.282206:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790947153.282270:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.282317:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8840 going to sleep for 11 seconds 00000100:00100000:1.0:1790947153.282341:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977856 00000100:00100000:1.0:1790947153.282348:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977856 00000100:00100000:1.0:1790947153.282391:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790947153.282400:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:24254:x1877943593977856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947153.282414:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947153.282426:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6ded21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6ded1a expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282446:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6ded21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded1a expref: 21 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282457:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cf200/0xe6f6b79c2d6ded21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded1a expref: 21 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282464:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cf200, rc 0) 00000100:00100000:1.0:1790947153.282501:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593977856:12345-0@lo:101:mount.lustre.0 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.282507:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790947153.282567:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947153.282581:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded21 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.282589:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6ded21 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790947153.285361:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1790947153.285646:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947153.285844:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1790947153.286439:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1790947153.286461:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1790947153.286475:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1790947153.286490:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1790947153.286504:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1790947153.286519:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1790947153.286533:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1790947153.286547:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1790947153.286560:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1790947153.286573:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1790947153.286587:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1790947153.286601:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1790947153.286613:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1790947153.286627:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1790947153.286656:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1790947153.286673:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1790947153.286687:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1790947153.286699:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1790947153.286712:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1790947153.286727:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1790947153.286741:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1790947153.286756:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1790947153.286785:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1790947153.286800:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1790947153.286814:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1790947153.286828:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1790947153.286842:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1790947153.286875:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1790947153.286896:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1790947153.286910:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1790947153.286938:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1790947153.287902:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1790947153.287936:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1790947153.288780:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1790947153.288824:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1790947153.288839:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1790947153.288852:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1790947153.288903:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1790947153.288918:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1790947153.288932:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1790947153.288946:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1790947153.288972:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1790947153.288986:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1790947153.289000:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1790947153.289182:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1790947153.289204:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1790947153.290227:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1790947153.290382:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1790947153.290400:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1790947153.290414:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1790947153.290418:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1790947153.290512:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947153.290567:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.290640:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.302946:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593977984 00000100:00100000:3.0:1790947153.302969:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593977984 00000100:00100000:3.0:1790947153.303035:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790947153.303045:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593977984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790947153.303226:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593977984:12345-0@lo:501:mount.lustre.0 Request processed in 182us (12657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.303236:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790947153.305590:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593977984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947153.305659:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790947153.305741:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.305988:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.311869:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978112 00000100:00100000:3.0:1790947153.311884:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978112 00000100:00100000:3.0:1790947153.311947:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790947153.311956:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947153.312304:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978112:12345-0@lo:503:mount.lustre.0 Request processed in 340us (6554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.312312:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790947153.312413:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978112:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790947153.312849:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790947153.312983:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.313112:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947153.313139:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c614c840 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.313293:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978240 00000100:00100000:3.0:1790947153.313309:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978240 00000100:00100000:3.0:1790947153.313345:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790947153.313353:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947153.313446:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978240:12345-0@lo:502:mount.lustre.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.313453:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790947153.313560:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947153.313753:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1790947153.313788:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1790947153.313802:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1790947153.313817:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1790947153.313831:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1790947153.313843:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1790947153.313895:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1790947153.313915:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1790947153.313931:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1790947153.313945:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1790947153.313977:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1790947153.313992:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1790947153.314004:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1790947153.314032:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1790947153.314047:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1790947153.314059:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1790947153.314072:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1790947153.314083:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1790947153.314096:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1790947153.314109:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1790947153.314121:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1790947153.314133:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1790947153.314148:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1790947153.314162:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1790947153.314176:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1790947153.314191:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1790947153.314231:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1790947153.314248:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1790947153.314262:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1790947153.314274:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1790947153.314286:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1790947153.314311:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1790947153.314326:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1790947153.314338:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1790947153.314360:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1790947153.314371:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1790947153.314382:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1790947153.314393:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1790947153.314404:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1790947153.314414:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1790947153.314427:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1790947153.314439:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1790947153.314464:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1790947153.314486:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1790947153.314500:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1790947153.314513:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1790947153.314524:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1790947153.314534:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1790947153.314572:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.314621:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947153.314650:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790947153.315162:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978368 00000100:00100000:3.0:1790947153.315170:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978368 00000100:00100000:3.0:1790947153.315226:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790947153.315235:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947153.315362:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978368:12345-0@lo:502:mount.lustre.0 Request processed in 128us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.315369:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790947153.315913:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947153.320236:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1790947153.320312:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1790947153.320365:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947153.320444:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947153.320488:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790947153.320709:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978496 00000100:00100000:0.0:1790947153.320716:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978496 00000100:00100000:0.0:1790947153.320770:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790947153.320779:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947153.320911:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593978496:12345-0@lo:502:mount.lustre.0 Request processed in 133us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947153.320919:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790947153.321141:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593978496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947153.321194:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1790947153.321203:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790947153.324438:0:24280:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790947153.324455:0:24280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94b1fd2acd40) 00000020:00000080:2.0:1790947153.324478:0:24280:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1790947153.324579:0:24280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1fcd76000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790947153.324584:0:24280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1fcd76000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790947153.324586:0:24280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1fcd76000 3 00010000:00080000:2.0:1790947153.324615:0:24280:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b1c5562800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1790947153.326615:0:24280:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1790947153.329019:0:24280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790947153.329139:0:24280:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790947153.329152:0:24280:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe6f6b79c2d6ded2f 00000100:00080000:2.0:1790947153.329161:0:24280:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790947153.329172:0:24280:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94b1c5562800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947153.329204:0:24280:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c83100 x1877943593978624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947153.329559:0:24280:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1790947153.329815:0:24280:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790947153.329831:0:24280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94b1f6c819c0) 00000020:00000080:2.0:1790947153.329846:0:24280:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1790947153.330028:0:24280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1fcd76000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790947153.330032:0:24280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1fcd76000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790947153.330035:0:24280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1fcd76000 3 00000100:00100000:1.0:1790947153.330130:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1877943593978624:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790947153.330133:0:24280:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c8573000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.129@tcp at head 00000100:00100000:1.0:1790947153.330197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790947153.330306:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.330311:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947153.330314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.330317:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947153.330342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.330345:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947153.330348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.330351:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790947153.330378:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978624 00000100:00100000:1.0:1790947153.330385:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978624 00000100:00100000:1.0:1790947153.330413:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790947153.330420:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1877943593978624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790947153.330443:0:22753:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:1.0:1790947153.330479:0:22753:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe6f6b79c2d6ded3d 00000004:00100000:1.0:1790947153.330491:0:22753:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790947153.330520:0:22753:0:(import.c:65:import_set_state_nolock()) ffff94b0c73c6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790947153.330567:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877943593978624:12345-0@lo:38:llog_process_th.0 Request processed in 146us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.330579:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790947153.330604:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593978880:0@lo:400:kworker.0 00000100:00100000:1.0:1790947153.330630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.330650:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790947153.330655:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593979008:0@lo:400:kworker.0 00000100:00100000:1.0:1790947153.330679:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.330706:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978880 00000100:00100000:1.0:1790947153.330710:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978880 00000100:00100000:1.0:1790947153.330738:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790947153.330745:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593978880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947153.330781:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593978880:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.330787:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1790947153.330828:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b1c2eb1180 x1877943593978880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947153.330842:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593978880:0@lo:400:kworker.0 00010000:00080000:1.0:1790947153.330885:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7c83100 x1877943593978624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790947163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947153.330893:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790947153.330899:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1790947153.330906:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790947153.330910:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790947153.330912:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1c5562800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790947153.330918:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1877943593978624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790947153.331396:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593978752:0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331429:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947153.331454:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790947153.331460:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593979136:0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331482:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947153.331526:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979008 00000100:00100000:3.0:1790947153.331531:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979008 00000100:00100000:3.0:1790947153.331556:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593978752 00000100:00100000:3.0:1790947153.331558:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593978752 00000100:00100000:3.0:1790947153.331570:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790947153.331576:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593979008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331616:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593979008:12345-0@lo:400:kworker.0 Request processed in 39us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.331622:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790947153.331635:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790947153.331641:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593978752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331689:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593978752:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.331696:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790947153.331731:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593978752:0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331756:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593979008:0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331770:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979136 00000100:00100000:3.0:1790947153.331773:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979136 00000100:00100000:3.0:1790947153.331796:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790947153.331802:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593979136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947153.331835:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593979136:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947153.331841:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790947153.331900:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b1c2eb2300 x1877943593979136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947153.331909:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593979136:0@lo:400:kworker.0 00010000:00010000:2.0:1790947153.333584:0:24280:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1790947153.333844:0:24280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1790947153.333911:0:24280:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790947153.333922:0:24280:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe6f6b79c2d6ded44 00000100:00080000:2.0:1790947153.333932:0:24280:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790947153.333941:0:24280:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff94b0c8573000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947153.334043:0:24280:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7c82680 x1877943593979264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947153.334136:0:24280:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790947153.334330:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1877943593979264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790947153.334401:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790947153.334462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.334467:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947153.334469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000040:00080000:3.0:1790947153.336199:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00080000:1.0:1790947153.336610:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947153.336615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.336618:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947153.336621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947153.336624:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790947153.336655:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979264 00000100:00100000:1.0:1790947153.336663:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979264 00000100:00100000:1.0:1790947153.336697:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790947153.336705:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877943593979264:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790947153.336735:0:22754:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:1.0:1790947153.336769:0:22754:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe6f6b79c2d6ded4b 00000004:00100000:1.0:1790947153.336786:0:22754:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790947153.336819:0:22754:0:(import.c:65:import_set_state_nolock()) ffff94b0c73c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790947153.336910:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877943593979264:12345-0@lo:38:llog_process_th.0 Request processed in 204us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.336917:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790947153.336960:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94b0c7c82680 x1877943593979264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790947163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947153.336986:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790947153.336994:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1790947153.337002:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790947153.337072:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790947153.337075:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c8573000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790947153.337083:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1877943593979264:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1790947153.337113:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790947153.337148:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790947153.337169:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded21 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.337180:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c13cfa00/0xe6f6b79c2d6ded1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded21 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790947153.337237:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790947153.337240:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790947153.337241:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947153.337242:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947153.337243:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947153.337245:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947153.337246:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790947153.337248:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947153.337250:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790947153.337253:0:24254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1790947153.337255:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790947153.337256:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790947153.337258:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947153.337259:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947153.337260:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947153.337261:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947153.337262:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790947153.337267:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947153.337268:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790947153.337286:0:24254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790947153.337313:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593979392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790947153.337352:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947153.337383:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c15b89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790947153.337399:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979392 00000100:00100000:1.0:1790947153.337403:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979392 00000100:00100000:1.0:1790947153.337434:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790947153.337440:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593979392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790947153.337463:0:22746:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790947153.337475:0:22746:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790947153.343104:0:22746:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790947153.343126:0:22746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790947153.343500:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:24254:x1877943593979392:12345-0@lo:253:mount.lustre.0 Request processed in 6055us (6142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.343513:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790947153.343578:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:24254:1877943593979392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790947153.343591:0:24254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790947153.343594:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790947153.343596:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790947153.343597:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947153.343598:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947153.343599:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947153.343601:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947153.343602:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790947153.343604:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947153.343606:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790947153.343620:0:24254:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790947153.345147:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790947153.345155:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790947153.345179:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.345195:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.345203:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.345308:0:22768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.345345:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.345359:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 20 pid: 22744 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947153.345372:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593979520:0@lo:104: 00000100:00100000:3.0:1790947153.345421:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790947153.345542:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947153.345553:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947153.345562:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593979648:0@lo:104: 00000100:00100000:3.0:1790947153.345587:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947153.345610:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c56b1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790947153.345739:0:22735:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790947153.345754:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979520 00000100:00100000:0.0:1790947153.345762:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979520 00000100:00100000:0.0:1790947153.345792:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979648 00000100:00100000:0.0:1790947153.345795:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979648 00000100:00100000:0.0:1790947153.345809:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790947153.345817:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:22768:x1877943593979520:12345-0@lo:104: 00010000:00010000:0.0:1790947153.345828:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.345900:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790947153.345906:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:22768:x1877943593979520:12345-0@lo:104: Request processed in 90us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947153.345913:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790947153.345929:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790947153.345935:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c6e05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593979648:12345-0@lo:104: 00010000:00010000:0.0:1790947153.345943:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.345985:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790947153.345989:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c6e05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593979648:12345-0@lo:104: Request processed in 55us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947153.345995:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790947153.346043:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593979520:0@lo:104: 00000100:00100000:0.0:1790947153.346052:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593979648:0@lo:104: 00010000:00010000:0.0:1790947153.346228:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346248:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947153.346253:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346258:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a800 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947153.346262:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346270:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947153.346283:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947153.346287:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790947153.346330:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346486:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947153.346513:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346521:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646a800/0xe6f6b79c2d6deca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decaa expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346533:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947153.346536:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346542:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a200 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947153.346545:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346552:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947153.346558:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947153.346564:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1790947153.346575:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3642:1877943593979776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947153.346588:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346593:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790947153.346606:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790947153.346607:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346613:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646a200/0xe6f6b79c2d6dec95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dec9c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.346626:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947153.346628:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947153.346629:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947153.346635:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947153.346645:0:22738:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979776 00000100:00100000:0.0:1790947153.346645:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593979904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790947153.346649:0:22738:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979776 00010000:00010000:1.0:1790947153.346666:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 21 pid: 22744 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947153.346689:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790947153.346696:0:22738:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3642:x1877943593979776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947153.346706:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947153.346710:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 21 pid: 22744 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346721:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 21 pid: 22744 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346733:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6decaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6deca3 expref: 21 pid: 22744 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947153.346737:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790947153.346745:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790947153.346770:0:22738:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:3642:x1877943593979776:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947153.346770:0:22737:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790947153.346776:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790947153.346776:0:22737:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790947153.346788:0:22738:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593979904 00000100:00100000:1.0:1790947153.346791:0:22738:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593979904 00010000:00010000:1.0:1790947153.346802:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947153.346817:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790947153.346822:0:22738:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1d0682050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:3639:x1877943593979904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947153.346830:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947153.346833:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346845:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346855:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cec00/0xe6f6b79c2d6dec9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6dec95 expref: 20 pid: 22746 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346885:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346892:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790947153.346905:0:22738:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004412575s 00010000:00010000:1.0:1790947153.346909:0:22738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346916:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346922:0:22738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346929:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346934:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29400 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947153.346938:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346945:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346972:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947153.346982:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790947153.347017:0:22738:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1d0682050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:3639:x1877943593979904:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947153.347024:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790947153.347026:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.347034:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947153.347040:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6ded52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947153.347066:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3642:1877943593979776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947153.347134:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593979904:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1790947153.349139:0:24254:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1790947153.357396:0:24254:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790947153.357404:0:24254:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790947153.357444:0:24254:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790947153.357554:0:24254:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790947153.357575:0:24254:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790947153.357593:0:24254:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790947153.358403:0:24254:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790947153.358708:0:24254:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790947153.747002:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790947154.062906:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1790947154.324547:0:24335:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790947154.324765:0:24335:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1790947154.511885:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790947154.511893:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b0c7116800 from 13 10000000:01000000:0.0:1790947154.511912:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947154.511955:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947154.511967:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947154.511979:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947154.512004:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947154.512068:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947154.512108:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790947154.522356:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980032 00000100:00100000:2.0:1790947154.522369:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980032 00000100:00100000:2.0:1790947154.522420:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790947154.522430:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+19:22749:x1877943593980032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947154.522448:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947154.522468:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6ded59 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.522498:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 20 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.522510:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 20 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.522528:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222c00, rc 0) 00000100:00100000:2.0:1790947154.522603:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:22749:x1877943593980032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (10534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947154.522609:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790947154.522661:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947154.522678:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.522688:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947154.522750:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790947154.522786:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947154.522822:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947154.522836:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980160 00000100:00100000:2.0:1790947154.522840:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980160 00000100:00100000:2.0:1790947154.522891:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790947154.522898:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:22749:x1877943593980160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790947154.522912:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790947154.522928:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790947154.522931:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790947154.523006:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:22749:x1877943593980160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947154.523013:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790947154.523045:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790947154.523101:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790947154.523108:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523116:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947154.523126:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790947154.523129:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b1fcde2000 from 13 10000000:01000000:2.0:1790947154.523131:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790947154.523150:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523156:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523164:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947154.523198:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790947154.523220:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947154.523245:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947154.523259:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980288 00000100:00100000:2.0:1790947154.523263:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980288 00000100:00100000:2.0:1790947154.523284:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790947154.523301:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:22749:x1877943593980288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947154.523308:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947154.523317:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6ded67 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523330:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523338:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523344:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223e00, rc 0) 00000100:00100000:2.0:1790947154.523371:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943593980288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947154.523377:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790947154.523404:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947154.523414:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523421:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947154.523459:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790947154.523483:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947154.523497:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947154.523508:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980416 00000100:00100000:2.0:1790947154.523511:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980416 00000100:00100000:2.0:1790947154.523531:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790947154.523536:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943593980416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790947154.523546:0:22747:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790947154.523556:0:22747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790947154.523559:0:22747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790947154.523616:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943593980416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947154.523623:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790947154.523651:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593980416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790947154.523684:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790947154.523690:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947154.523698:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947154.773706:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947155.790194:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947156.819452:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947157.710046:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593980672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947157.710120:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947157.710186:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980672 00000100:00100000:3.0:1790947157.710193:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980672 00000100:00100000:3.0:1790947157.710235:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947157.710244:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593980672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790947157.710288:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790947157.710331:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593980672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947157.710339:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947157.710381:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593980672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790947157.710455:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593980544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947157.710485:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947157.710518:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980544 00000100:00100000:0.0:1790947157.710522:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980544 00000100:00100000:0.0:1790947157.710543:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790947157.710549:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593980544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790947157.710576:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790947157.710607:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593980544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947157.710613:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790947157.710641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593980544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790947157.838065:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790947158.736174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947158.736181:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947158.736183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947158.736186:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947158.736217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947158.736219:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790947158.736222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947158.736225:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790947158.736278:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593981184:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.736407:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.737510:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790947158.737522:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593980800:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.737568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.737606:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593981312:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.737633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.739998:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593980928:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740060:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.740092:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1877943593981440:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.740149:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790947158.740157:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593981056:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740178:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.740196:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943593981568:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740220:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947158.740268:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981184 00000100:00100000:2.0:1790947158.740276:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981184 00000100:00100000:2.0:1790947158.740316:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980928 00000100:00100000:2.0:1790947158.740319:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980928 00000100:00100000:2.0:1790947158.740351:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790947158.740360:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593981184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740417:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593981184:12345-0@lo:400:kworker.0 Request processed in 58us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947158.740423:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790947158.740441:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790947158.740447:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593980928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740479:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593980928:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947158.740485:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790947158.740505:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593980800 00000100:00100000:2.0:1790947158.740509:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593980800 00000100:00100000:2.0:1790947158.740533:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790947158.740538:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3641:x1877943593980800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.740568:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3641:x1877943593980800:12345-0@lo:400:kworker.0 Request processed in 29us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947158.740573:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790947158.740600:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981312 00000100:00100000:2.0:1790947158.740604:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981312 00000100:00100000:2.0:1790947158.740620:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981440 00000100:00100000:2.0:1790947158.740623:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981440 00000100:00100000:2.0:1790947158.740645:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981056 00000100:00100000:2.0:1790947158.740648:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981056 00000100:00100000:3.0:1790947158.741936:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981568 00000100:00100000:3.0:1790947158.741945:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981568 00000100:00100000:3.0:1790947158.741975:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790947158.741985:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593981312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947158.742044:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593981312:12345-0@lo:400:kworker.0 Request processed in 60us (4409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947158.742050:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790947158.742068:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947158.742074:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877943593981440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947158.742102:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877943593981440:12345-0@lo:400:kworker.0 Request processed in 29us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947158.742107:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947158.742119:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947158.742125:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943593981568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947158.742150:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943593981568:12345-0@lo:400:kworker.0 Request processed in 26us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947158.742164:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790947158.742897:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790947158.742907:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593981056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.742952:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593981056:12345-0@lo:400:kworker.0 Request processed in 48us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947158.742971:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790947158.743012:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790947158.743016:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790947158.743047:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7c83800 x1877943593981056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947158.743060:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593981056:0@lo:400:kworker.0 00010000:00080000:2.0:1790947158.743073:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7c83b80 x1877943593981568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947158.743081:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943593981568:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.743094:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593980928:0@lo:400:kworker.0 00010000:00080000:2.0:1790947158.743103:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7c81f80 x1877943593981440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947158.743111:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1877943593981440:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.743149:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593980800:0@lo:400:kworker.0 00010000:00080000:2.0:1790947158.743159:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7c81c00 x1877943593981312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947158.743166:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593981312:0@lo:400:kworker.0 00000100:00100000:2.0:1790947158.743176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593981184:0@lo:400:kworker.0 00010000:00010000:1.0:1790947158.862605:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947159.700668:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790947159.889802:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790947160.662929:0:24626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790947160.913626:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947161.550645:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947146/real 1790947146] req@ffff94b0c84e7100 x1877943593973632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947161 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947161.550685:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c84e7100 x1877943593973632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947161 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947161.550697:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947146/real 1790947146] req@ffff94b0c7c80380 x1877943593973376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947161 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947161.550709:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7c80380 x1877943593973376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947161 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790947161.550731:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947161.550756:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947161.550760:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593973632:0@lo:8:kworker.0 00000100:00080000:0.0:1790947161.550766:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947161.550772:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947161.550775:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593973376:0@lo:8:kworker.0 00000100:00080000:3.0:1790947161.551162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947161.551167:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947161.551169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947161.551173:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790947161.551199:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947161.551203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790947161.551206:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b0c774c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947161.551210:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1790947161.551216:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790947161.551226:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94b0c774c800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947161.551256:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c77e2a00 x1877943593982208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947161.551271:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947161.551274:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790947161.551276:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947161.551279:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1790947161.551281:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790947161.551285:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947161.551296:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c77e2300 x1877943593982336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947161.551335:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593981952:0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.551391:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.551430:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943593982720:0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.551457:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.551476:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790947161.551888:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593981824:0@lo:400:kworker.0 00000100:00100000:0.0:1790947161.551930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947161.551977:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593982592:0@lo:400:kworker.0 00000100:00100000:2.0:1790947161.552100:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593981696:0@lo:400:kworker.0 00000100:00100000:2.0:1790947161.552137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947161.552169:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593982464:0@lo:400:kworker.0 00000100:00100000:2.0:1790947161.552191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947161.552230:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981696 00000100:00100000:2.0:1790947161.552248:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981696 00000100:00100000:2.0:1790947161.552293:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790947161.552301:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3641:x1877943593981696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947161.552608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947161.552832:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3641:x1877943593981696:12345-0@lo:400:kworker.0 Request processed in 531us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947161.552840:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790947161.552901:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981952 00000100:00100000:2.0:1790947161.552905:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981952 00000100:00100000:2.0:1790947161.552924:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982720 00000100:00100000:2.0:1790947161.552927:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982720 00000100:00100000:3.0:1790947161.553204:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593982080:0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.553282:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982464 00000100:00100000:3.0:1790947161.553285:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982464 00000100:00100000:3.0:1790947161.553303:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982592 00000100:00100000:3.0:1790947161.553305:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982592 00000100:00100000:3.0:1790947161.553319:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790947161.553326:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593981952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553363:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593981952:12345-0@lo:400:kworker.0 Request processed in 37us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.553370:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790947161.553382:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790947161.553387:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593982464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553413:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593982464:12345-0@lo:400:kworker.0 Request processed in 26us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.553419:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790947161.553432:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790947161.553438:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593982592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553471:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593982592:12345-0@lo:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.553476:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790947161.553508:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593981824 00000100:00100000:3.0:1790947161.553512:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593981824 00000100:00100000:3.0:1790947161.553534:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982080 00000100:00100000:3.0:1790947161.553546:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982080 00000100:00100000:3.0:1790947161.553564:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790947161.553569:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593981824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553601:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593981824:12345-0@lo:400:kworker.0 Request processed in 31us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.553606:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790947161.553616:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790947161.553621:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553647:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593982080:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.553652:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790947161.553686:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593981824:0@lo:400:kworker.0 00010000:00080000:3.0:1790947161.553701:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e3800 x1877943593982592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.553709:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593982592:0@lo:400:kworker.0 00000100:00100000:3.0:1790947161.553733:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593982208:0@lo:8:kworker.0 00000100:00100000:3.0:1790947161.553763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.553779:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593982336:0@lo:8:kworker.0 00000100:00100000:3.0:1790947161.553801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.553848:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593982080:0@lo:400:kworker.0 00010000:00080000:3.0:1790947161.553875:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e0a80 x1877943593981952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.553885:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593981952:0@lo:400:kworker.0 00000100:00100000:2.0:1790947161.554137:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790947161.554146:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943593982720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947161.554183:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943593982720:12345-0@lo:400:kworker.0 Request processed in 39us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947161.554189:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790947161.554214:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790947161.554218:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790947161.554244:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982208 00000100:00100000:2.0:1790947161.554248:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982208 00000100:00100000:2.0:1790947161.554262:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982336 00000100:00100000:2.0:1790947161.554264:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982336 00000100:00100000:2.0:1790947161.554273:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790947161.554278:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1877943593982208:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790947161.554301:0:24260:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1790947161.554328:0:24260:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6ded75 00002000:00100000:2.0:1790947161.554347:0:24260:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff94b0c8575800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790947161.554352:0:24260:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790947161.554355:0:24260:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790947161.554520:0:24260:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790947161.554544:0:24260:0:(import.c:65:import_set_state_nolock()) ffff94b0c8574000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947161.554579:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1877943593982208:12345-0@lo:8:kworker.0 Request processed in 300us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947161.554586:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790947161.554599:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790947161.554603:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1877943593982336:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790947161.554615:0:24260:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790947161.555295:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593981696:0@lo:400:kworker.0 00010000:00080000:0.0:1790947161.555312:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e1180 x1877943593982464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947161.555321:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593982464:0@lo:400:kworker.0 00010000:00080000:3.0:1790947161.555578:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e2a00 x1877943593982208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790947181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.555598:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790947161.555605:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790947161.555613:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790947161.555618:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790947161.555621:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790947161.555684:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790947161.555690:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593982208:0@lo:8:kworker.0 00010000:00080000:3.0:1790947161.555720:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e1500 x1877943593982720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.555729:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943593982720:0@lo:400:kworker.0 00000004:00080000:1.0:1790947161.558391:0:23494:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790947161.558505:0:23494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 657639645589ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790947161.558513:0:23494:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1790947161.560014:0:23495:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790947161.560112:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23495:1877943593982976:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1790947161.560180:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947161.560212:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790947161.560243:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790947161.560257:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593982848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790947161.560284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947161.560321:0:24259:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790947161.560329:0:24259:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790947161.560458:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982976 00000100:00100000:0.0:1790947161.560466:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982976 00000100:00100000:0.0:1790947161.560673:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790947161.560684:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23495:x1877943593982976:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1790947161.561556:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593982848 00000100:00100000:3.0:1790947161.561565:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593982848 00000100:00100000:3.0:1790947161.561597:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790947161.561606:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1877943593982848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790947161.561631:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947161.561719:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1877943593982848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.561727:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790947161.561784:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7f08a80 x1877943593982848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790947177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.561805:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593982848:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1790947161.582998:0:24665:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1790947161.583011:0:24665:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790947161.583112:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23495:x1877943593982976:12345-0@lo:7:osp-pre-0-1.0 Request processed in 22427us (22928us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.583137:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790947161.583201:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7f0aa00 x1877943593982976/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790947177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.583217:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23495:1877943593982976:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1790947161.583231:0:23495:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790947161.583285:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23495:1877943593983104:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790947161.583317:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.583343:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ebdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790947161.583362:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983104 00000100:00100000:3.0:1790947161.583367:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983104 00000100:00100000:3.0:1790947161.583409:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790947161.583419:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23495:x1877943593983104:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790947161.583461:0:24259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1790947161.583669:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23495:x1877943593983104:12345-0@lo:5:osp-pre-0-1.0 Request processed in 252us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.583677:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790947161.583710:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e74380 x1877943593983104/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790947177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.583719:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23495:1877943593983104:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790947161.583727:0:23495:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790947161.583752:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23495:1877943593983232:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790947161.583775:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.583791:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ebdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790947161.583803:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983232 00000100:00100000:3.0:1790947161.584165:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983232 00000100:00100000:3.0:1790947161.584200:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790947161.584210:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23495:x1877943593983232:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790947161.584249:0:24665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:1.0:1790947161.589969:0:23485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1790947161.590925:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947161.617296:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1877943593982336:12345-0@lo:8:kworker.0 Request processed in 62683us (63485us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790947161.617311:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790947161.617372:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790947161.617377:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790947161.617381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593982336:0@lo:8:kworker.0 00000001:00080000:0.0:1790947161.633564:0:24255:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1790947161.633580:0:24255:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790947161.633835:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23495:x1877943593983232:12345-0@lo:5:osp-pre-0-1.0 Request processed in 49623us (50053us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1790947161.633846:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790947161.635755:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e74380 x1877943593983232/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790947177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.635770:0:23495:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1790947161.635777:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23495:1877943593983232:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790947161.635792:0:23495:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1790947161.635881:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23495:1877943593983360:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790947161.635939:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947161.635969:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ebdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790947161.636002:0:22764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983360 00000100:00100000:3.0:1790947161.636008:0:22764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983360 00000100:00100000:3.0:1790947161.636052:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790947161.636061:0:22764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23495:x1877943593983360:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790947161.636111:0:22764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23495:x1877943593983360:12345-0@lo:900:osp-pre-0-1.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947161.636119:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790947161.636149:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e74380 x1877943593983360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790947177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947161.636158:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23495:1877943593983360:0@lo:900:osp-pre-0-1.0 00000020:00000004:3.0:1790947161.701479:0:24679:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790947161.701696:0:24679:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790947161.937912:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790947162.574302:0:24729:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790947162.574492:0:24729:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790947162.831431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593983488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790947162.831509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947162.831640:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983488 00000100:00100000:1.0:1790947162.831648:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983488 00000100:00100000:1.0:1790947162.831744:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790947162.831754:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593983488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790947162.831787:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790947162.831848:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593983488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947162.831873:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790947162.832034:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593983488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947162.832937:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593983616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790947162.832989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947162.834691:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983616 00000100:00100000:1.0:1790947162.834704:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983616 00000100:00100000:1.0:1790947162.834762:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790947162.834773:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593983616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947162.834809:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790947162.834915:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593983616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947162.837037:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593983616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790947162.837170:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1790947162.958096:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947163.988739:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947164.302677:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790947165.006040:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947166.034976:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947166.926039:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790947166.926063:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593983744:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790947166.926134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947166.926139:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790947166.926143:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947166.926146:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790947166.926157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790947166.926174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947166.926179:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790947166.926184:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790947166.926190:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:1.0:1790947166.926207:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790947166.926218:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947166.926234:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3640:1877943593983872:0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.926241:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1c2eb2300 x1877943593984512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947166.926271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947166.926305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593984384:0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.926321:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593984000:0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.926336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947166.926360:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790947166.926367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947166.926369:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593984256:0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.926399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947166.926400:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593984640:0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.926425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593984896:0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.926435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947166.926456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947166.926461:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790947166.926469:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877943593984128:0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.926500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947166.926515:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983744 00000100:00100000:3.0:1790947166.926523:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983744 00000100:00100000:1.0:1790947166.926526:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1877943593984768:0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.926553:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947166.926590:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790947166.926591:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593984512:0@lo:8:kworker.0 00000100:00100000:3.0:1790947166.926603:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593983744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790947166.926636:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790947166.927091:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984640 00000100:00100000:2.0:1790947166.927097:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984640 00000100:00100000:2.0:1790947166.927149:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984896 00000100:00100000:2.0:1790947166.927153:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984896 00000100:00100000:2.0:1790947166.927168:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984128 00000100:00100000:2.0:1790947166.927170:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984128 00000100:00100000:2.0:1790947166.927184:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984768 00000100:00100000:2.0:1790947166.927187:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984768 00000100:00100000:2.0:1790947166.927218:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790947166.927226:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593984640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.932187:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593983744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5577us (6019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947166.932213:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790947166.932268:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790947166.932283:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.932437:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593984896:12345-0@lo:400:kworker.0 Request processed in 160us (5980us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947166.932450:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790947166.932521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947166.932580:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984000 00000100:00100000:1.0:1790947166.932589:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984000 00000100:00100000:1.0:1790947166.932629:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984256 00000100:00100000:1.0:1790947166.932632:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984256 00000100:00100000:1.0:1790947166.932651:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790947166.932660:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593984000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.932708:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593984000:12345-0@lo:400:kworker.0 Request processed in 51us (6343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947166.932716:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790947166.932731:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790947166.932739:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593984256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.932778:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593984256:12345-0@lo:400:kworker.0 Request processed in 41us (6380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947166.932784:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790947166.932818:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790947166.932825:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877943593984128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.932874:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877943593984128:12345-0@lo:400:kworker.0 Request processed in 33us (6356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947166.932880:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790947166.932895:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790947166.932902:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877943593984768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.932930:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877943593984768:12345-0@lo:400:kworker.0 Request processed in 30us (6377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947166.932936:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790947166.932972:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984384 00000100:00100000:1.0:1790947166.932976:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984384 00000100:00080000:3.0:1790947166.933014:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790947166.933019:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790947166.933022:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790947166.933066:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593984256:0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.933140:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593984512 00000100:00100000:1.0:1790947166.933145:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593984512 00000100:00100000:1.0:1790947166.933167:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790947166.933176:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593984384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947166.933222:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593984384:12345-0@lo:400:kworker.0 Request processed in 47us (6886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947166.933228:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790947166.933242:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790947166.933245:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1877943593984512:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790947166.933262:0:24259:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790947166.933293:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1877943593984512:12345-0@lo:8:kworker.0 Request processed in 46us (773us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790947166.933298:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790947166.933330:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790947166.933341:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790947166.933344:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593984512:0@lo:8:kworker.0 00010000:00080000:1.0:1790947166.933376:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1c2eb0e00 x1877943593984128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1790947166.933381:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c84e7100 x1877943593984896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947166.933394:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877943593984128:0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.933402:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c84e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593984896:0@lo:400:kworker.0 00010000:00080000:1.0:1790947166.933410:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1c2eb2680 x1877943593984768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947166.933419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1877943593984768:0@lo:400:kworker.0 00010000:00080000:3.0:1790947166.933425:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1c2eb2d80 x1877943593984384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790947182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947166.933436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593984000:0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.933437:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593984384:0@lo:400:kworker.0 00010000:00080000:3.0:1790947166.933526:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e74380 x1877943593983744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790947182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947166.933543:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593983744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790947166.934209:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593983872 00000100:00100000:3.0:1790947166.934216:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593983872 00000100:00100000:3.0:1790947166.934265:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790947166.934275:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3640:x1877943593983872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947166.934285:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593984640:12345-0@lo:400:kworker.0 Request processed in 7057us (7847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947166.934295:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1790947166.934336:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1c2eb3100 x1877943593984640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947166.934346:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593984640:0@lo:400:kworker.0 00000100:00100000:3.0:1790947166.934816:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3640:x1877943593983872:12345-0@lo:400:kworker.0 Request processed in 542us (8545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947166.934824:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790947166.934898:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c2eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3640:1877943593983872:0@lo:400:kworker.0 00010000:00010000:2.0:1790947167.055730:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947167.953113:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790947167.953136:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593985024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790947167.953233:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947167.953233:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947147/real 1790947147] req@ffff94b0c7e75f80 x1877943593974784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947167.953258:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7e75f80 x1877943593974784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947167.953268:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790947147/real 1790947147] req@ffff94b0c7e76680 x1877943593974912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947167.954878:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593985152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790947167.956946:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.957036:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985024 00000100:00100000:1.0:1790947167.957046:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985024 00000100:00100000:2.0:1790947167.957047:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985152 00000100:00100000:2.0:1790947167.957054:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985152 00000100:00100000:1.0:1790947167.957103:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790947167.957114:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593985024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947167.957152:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790947167.957219:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593985024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.957228:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790947167.958675:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94b0c7e76680 x1877943593974912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790947167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790947167.958703:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947167.959668:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947167.959681:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593974784:0@lo:8:kworker.0 00000100:00080000:0.0:1790947167.959690:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947167.959700:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790947167.959703:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593974912:0@lo:8:kworker.0 00000100:00080000:3.0:1790947167.961982:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947167.961993:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790947167.961997:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947167.962004:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:3.0:1790947167.962010:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790947167.962021:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94b0c7ea3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947167.962045:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c77e0a80 x1877943593985408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947167.962062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947167.962065:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790947167.962067:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947167.962070:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:3.0:1790947167.962073:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790947167.962077:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94b0c774b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947167.962088:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c77e2d80 x1877943593985536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790947167.962123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790947167.962126:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790947167.962128:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790947167.962131:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1790947167.962134:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790947167.962138:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947167.962149:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7e76680 x1877943593985920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947167.962216:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593985408:0@lo:8:kworker.0 00000100:00100000:3.0:1790947167.962288:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947167.962333:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593985536:0@lo:8:kworker.0 00000100:00100000:3.0:1790947167.962353:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947167.962368:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593985920:0@lo:8:kworker.0 00000100:00100000:3.0:1790947167.962385:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947167.963341:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593985792:0@lo:400:kworker.0 00000100:00100000:2.0:1790947167.963385:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947167.963443:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790947167.963450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593985664:0@lo:400:kworker.0 00000100:00100000:0.0:1790947167.963688:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985408 00000100:00100000:0.0:1790947167.963698:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985408 00000100:00100000:0.0:1790947167.963716:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985536 00000100:00100000:0.0:1790947167.963718:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985536 00000100:00100000:0.0:1790947167.963726:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985920 00000100:00100000:0.0:1790947167.963729:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985920 00000100:00100000:0.0:1790947167.963735:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985792 00000100:00100000:0.0:1790947167.963736:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985792 00000100:00100000:0.0:1790947167.963762:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790947167.963773:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593985792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947167.963827:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593985792:12345-0@lo:400:kworker.0 Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947167.963833:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790947167.963851:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790947167.963855:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1877943593985408:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790947167.963904:0:24261:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:0.0:1790947167.963935:0:24261:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6ded7c 00000100:00100000:1.0:1790947167.963962:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790947167.963979:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593985152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790947167.964016:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790947167.964055:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593985152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (7116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.964063:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790947167.964094:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790947167.964099:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1877943593985536:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790947167.964112:0:24259:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790947167.964149:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1877943593985536:12345-0@lo:8:kworker.0 Request processed in 48us (1795us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790947167.964155:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790947167.964170:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790947167.964175:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1877943593985920:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790947167.964595:0:24259:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790947167.964630:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1877943593985920:12345-0@lo:8:kworker.0 Request processed in 453us (2243us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790947167.964638:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790947167.964793:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3642:1877943593985280:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.964833:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.964976:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593986176:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.965004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.965026:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790947167.965032:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593986048:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.965049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.965075:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985280 00000100:00100000:1.0:1790947167.965087:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985280 00000100:00100000:1.0:1790947167.965122:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790947167.965130:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3642:x1877943593985280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.965401:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3642:x1877943593985280:12345-0@lo:400:kworker.0 Request processed in 272us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.965409:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790947167.965451:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986176 00000100:00100000:1.0:1790947167.965455:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986176 00000100:00100000:1.0:1790947167.965481:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986048 00000100:00100000:1.0:1790947167.965552:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986048 00000100:00100000:1.0:1790947167.965579:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790947167.965586:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593986176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.965620:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593986176:12345-0@lo:400:kworker.0 Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.965626:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790947167.965638:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790947167.965750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.965767:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593986048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947167.965785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593986304:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.965805:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593986048:12345-0@lo:400:kworker.0 Request processed in 104us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.965812:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790947167.965825:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593985664 00000100:00100000:1.0:1790947167.965831:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593985664 00000100:00100000:2.0:1790947167.965846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.965850:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790947167.965876:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593985664:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790947167.966150:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e1c00 x1877943593985792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790947183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947167.966152:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593985664:12345-0@lo:400:kworker.0 Request processed in 293us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.966169:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790947167.966175:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593985792:0@lo:400:kworker.0 00010000:00080000:2.0:1790947167.966219:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e3800 x1877943593985664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947167.966228:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593985664:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.966263:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986304 00000100:00100000:1.0:1790947167.966267:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986304 00000100:00100000:1.0:1790947167.966305:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790947167.966314:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593986304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.966364:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593986304:12345-0@lo:400:kworker.0 Request processed in 52us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947167.966371:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790947167.966419:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1f707f100 x1877943593986304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947167.966429:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593986304:0@lo:400:kworker.0 00010000:00080000:1.0:1790947167.966458:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e75f80 x1877943593986048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947167.966468:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593986048:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.966477:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3642:1877943593985280:0@lo:400:kworker.0 00010000:00080000:1.0:1790947167.966557:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e74380 x1877943593986176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947167.966567:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593986176:0@lo:400:kworker.0 00000100:00100000:1.0:1790947167.966618:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593985024:0@lo:41:osp-pre-0-1.0 00002000:00100000:0.0:1790947167.966706:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94b1ef876800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790947167.966711:0:24261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790947167.966714:0:24261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790947167.966784:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790947167.966817:0:24261:0:(import.c:65:import_set_state_nolock()) ffff94b1ef877000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790947167.966874:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877943593985408:12345-0@lo:8:kworker.0 Request processed in 2998us (4566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947167.966882:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790947167.967928:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c77e0a80 x1877943593985408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790947192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947167.967939:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790947167.967956:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00100000:1.0:1790947167.967958:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593985152:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1790947167.967965:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790947167.967972:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790947167.967976:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c7ea3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790947167.967994:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790947167.968000:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593985408:0@lo:8:kworker.0 00000004:00080000:1.0:1790947167.968011:0:22776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1790947167.968017:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947167.968022:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790947167.968025:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593985536:0@lo:8:kworker.0 00000100:00080000:0.0:1790947167.968036:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790947167.968040:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790947167.968043:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593985920:0@lo:8:kworker.0 00000004:00080000:1.0:1790947167.968086:0:22776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 664049226576ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790947167.968092:0:22776:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1790947167.968168:0:22777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1790947167.968249:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593986432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947167.968371:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1877943593986560:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790947167.968419:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947167.968419:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947167.968451:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c56b1900 going to sleep for 11 seconds 00000100:00100000:1.0:1790947167.968472:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986560 00000100:00100000:1.0:1790947167.968478:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986560 00000100:00100000:1.0:1790947167.968602:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947167.968611:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22777:x1877943593986560:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1790947167.969197:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790947167.973265:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986432 00000100:00100000:0.0:1790947167.973288:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986432 00000100:00100000:0.0:1790947167.975960:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790947167.975977:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877943593986432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790947167.976005:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790947167.976099:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877943593986432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (7685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947167.976115:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790947167.977060:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1f707ca80 x1877943593986432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790947183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1790947167.977085:0:22732:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1790947167.977087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593986432:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1790947167.979464:0:24259:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790947167.979477:0:24259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1790947167.979494:0:24259:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:0.0:1790947167.999927:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947167.999938:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947167.999956:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947167.999960:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947167.999968:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947167.999987:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947167.999997:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.000005:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.000027:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947168.000276:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947168.000284:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.000294:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947168.000299:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.000310:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.000329:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.000337:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c626120/0xe6f6b79c2d6ded83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.000358:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.000360:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.000362:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.000956:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.000966:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.000979:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.000984:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.000989:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001002:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001011:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001030:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001053:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947168.001166:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947168.001173:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001203:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13ce600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947168.001207:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001215:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001227:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001234:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6ded8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001249:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.001251:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.001252:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.001473:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.001480:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001489:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.001492:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.001496:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001505:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001513:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001521:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.001838:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947168.001899:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947168.001904:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001911:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cea00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947168.001915:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001924:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001945:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001952:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6ded91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.001973:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.001975:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.001977:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.002719:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.002727:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.002748:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.002752:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.002758:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.002771:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.002781:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.002790:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.002814:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947168.003709:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947168.003718:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.003728:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cec00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947168.003733:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.003742:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.003759:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.003767:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6ded98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.003800:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.003802:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.003804:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.007808:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.007822:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.007840:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.007844:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.007881:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.007906:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.007917:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.007925:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.007949:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.008233:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.008242:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.008253:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646ae00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.008257:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.008268:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.008297:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.008306:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6ded9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.008326:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.008329:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.008331:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.010105:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.010119:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.010136:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.010141:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.010148:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.010162:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.010173:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.011002:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.011027:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947168.012827:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.012840:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.012877:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.012882:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.012888:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.012914:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.012923:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.012931:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.012954:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790947168.013332:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947168.013340:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013349:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.013353:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013363:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013380:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013388:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6deda6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013416:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.013420:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013426:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.013428:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013435:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013444:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013450:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dedad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.013460:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.013462:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.013463:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.013966:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.018230:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.018245:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.018262:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.018277:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.018283:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.018299:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.018308:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.018316:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.018342:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790947168.019333:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.019342:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019354:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.019358:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.019364:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019374:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019382:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019396:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019421:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790947168.019723:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947168.019732:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019741:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cec00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947168.019747:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019757:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019784:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019804:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3b0fcb9/0xe6f6b79c2d6dedb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019828:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947168.019832:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019838:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cea00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947168.019842:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790947168.019843:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.019855:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.019882:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019892:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.019897:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.019961:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019973:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019983:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.019991:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.020002:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790947168.020029:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020038:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265481c9/0xe6f6b79c2d6dedbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020054:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947168.020058:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020067:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13ce600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947168.020077:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020086:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020097:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020105:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6dedc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.020120:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.020121:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.020124:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.020177:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.020602:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.020609:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.020626:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.020629:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.020634:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.020646:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.020654:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.020661:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.020686:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947168.020787:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947168.020800:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.020808:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947168.020812:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.020820:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.020836:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.020844:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013822bea/0xe6f6b79c2d6dedc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790947168.021167:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.021174:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021183:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.021199:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.021204:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021215:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021236:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021243:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021262:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.021272:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.021553:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.021561:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021571:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.021576:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021586:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021603:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021612:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6dedd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.021653:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.021657:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.021661:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.021667:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.021671:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.022171:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.022195:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022207:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.022211:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.022215:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022304:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022339:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022349:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022378:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.022404:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.022409:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022425:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601c00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.022430:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022439:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022455:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022463:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dedd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.022773:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.022776:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.022780:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.025371:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.025378:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.025381:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.027135:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.027148:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.027166:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.027171:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.027177:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.027409:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.027421:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.027429:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.027565:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947168.028216:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.028223:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.028235:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.028239:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.028244:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.028254:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.028265:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.028286:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030024:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947168.030039:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030053:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.030058:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030070:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030099:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030108:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dedde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030129:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.030134:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030141:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b400 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.030145:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030153:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030165:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030174:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.030175:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.030178:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.030260:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947168.030267:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008828dc1c/0xe6f6b79c2d6dede5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.030773:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.030849:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.030856:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.031635:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.031640:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.031646:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.031659:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.031668:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.031677:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.031920:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947168.032431:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.032439:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.032449:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.032453:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.032457:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.032468:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.032476:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.032492:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032587:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947168.032594:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032608:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b800 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.032613:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032621:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032638:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032651:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c606c67/0xe6f6b79c2d6dedec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032670:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.032673:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032679:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646bc00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.032682:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032690:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032823:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.032839:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.032841:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.032843:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.033601:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947168.033610:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099545448/0xe6f6b79c2d6dedf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790947168.034327:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.034335:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.034356:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.034360:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.034366:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.034379:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.034390:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.034397:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.034656:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.034664:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.034672:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646ba00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.034676:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.034685:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.034756:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.034766:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.034769:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.034771:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.034843:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947168.034849:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043d251ea/0xe6f6b79c2d6dedfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790947168.035542:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.035549:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.035560:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.035564:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.035569:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.035592:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.035601:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.035610:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.035838:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.036451:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.036462:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.036466:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.036550:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.036570:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.036581:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.036582:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.036584:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.036679:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947168.036686:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096cc5460/0xe6f6b79c2d6dee01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790947168.037267:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.037274:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.037286:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.037291:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.037297:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.037308:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.037330:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.037338:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.037659:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.037666:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.037674:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a800 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.037678:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.037687:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.037762:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.037772:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.037774:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.037776:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947168.037822:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947168.037828:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b8708f/0xe6f6b79c2d6dee08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.038039:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.038553:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.038560:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.038572:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.038576:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.038581:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.038590:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.038598:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.038619:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.038675:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947168.039760:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.039769:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.039784:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.039787:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.039792:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.039803:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.039813:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.039820:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043057:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947168.043076:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043090:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.043095:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043108:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043129:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043137:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19850b4/0xe6f6b79c2d6dee0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043167:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.043171:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043178:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.043182:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043200:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.043235:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.043355:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947168.043363:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a236181/0xe6f6b79c2d6dee16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.044252:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.044382:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.044390:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.044404:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.044409:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.044417:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.044431:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.044440:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.044449:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.044473:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.044892:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.044909:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.044918:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.044923:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.044932:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.044948:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.044956:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5bde159/0xe6f6b79c2d6dee1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.044976:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.044978:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.044979:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947168.045272:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947168.045279:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.045289:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1790947168.045293:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947168.045305:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.045316:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.045325:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.045333:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.045347:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.045726:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.045732:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.045747:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646ae00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.045751:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.045758:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.045771:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.045779:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8aeb3a/0xe6f6b79c2d6dee24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.045796:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.045798:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.045801:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947168.046629:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947168.046638:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046650:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1790947168.046654:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947168.046660:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046671:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046689:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046697:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046725:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.046936:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.046942:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046950:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601c00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.046954:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046963:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046976:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.046984:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a968033e/0xe6f6b79c2d6dee2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.047001:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.047008:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.047010:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.047845:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.047850:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.047852:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790947168.048711:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790947168.048723:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.048739:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1790947168.048744:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790947168.048750:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.048762:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.048771:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.048779:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.048837:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790947168.049415:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790947168.049424:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.049447:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1790947168.049450:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790947168.049455:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.049467:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.049475:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.049547:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055591:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947168.055605:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055619:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.055623:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055635:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055654:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055662:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079cf9f08/0xe6f6b79c2d6dee32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055684:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.055688:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055695:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.055698:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055728:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055740:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.055748:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.055749:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.055751:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.056599:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.056770:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790947168.056779:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003445c893/0xe6f6b79c2d6dee39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790947168.058440:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790947168.058452:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.058469:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1790947168.058474:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790947168.058480:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.058794:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.058805:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.058813:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.058915:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790947168.060311:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790947168.060322:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.060340:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1790947168.060344:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790947168.060350:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.060362:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.060372:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947168.060391:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060452:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947168.060460:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060467:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947168.060472:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060539:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060570:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060578:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019fdb413/0xe6f6b79c2d6dee40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060597:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947168.060601:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060609:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947168.060612:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060620:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060629:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.060637:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.060638:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947168.060640:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947168.060764:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790947168.060770:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ef1f38b/0xe6f6b79c2d6dee47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947168.061044:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790947168.062440:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790947168.062452:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.062476:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=664s v=(0 0) 00010000:00010000:3.0:1790947168.062480:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947168.062555:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.062568:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.062579:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.062587:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.062608:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947168.062932:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.062940:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.062951:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.062955:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.062965:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.062981:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.062989:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c851c09a/0xe6f6b79c2d6dee4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.063024:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.063026:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.063028:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790947168.063226:0:24259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790947168.063233:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.063242:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=664s v=(0 0) 00010000:00010000:3.0:1790947168.063245:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947168.063250:0:24259:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.063259:0:24259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.063280:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.063288:0:24259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947168.063312:0:24259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790947168.063349:0:24259:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1790947168.063509:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22777:x1877943593986560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94896us (95090us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947168.063519:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1790947168.063534:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947168.063542:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.063550:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c28600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947168.063554:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.063562:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.063574:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.063581:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e241b9e/0xe6f6b79c2d6dee55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947168.063594:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.063596:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947168.063598:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947168.063645:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1877943593986560:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790947168.063661:0:22777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1790947168.063834:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1877943593986688:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790947168.064037:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947168.064090:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1790947168.064135:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986688 00000100:00100000:2.0:1790947168.064141:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986688 00000100:00100000:2.0:1790947168.064313:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790947168.064323:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22777:x1877943593986688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790947168.064359:0:24260:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1790947168.077308:0:24255:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1790947168.077360:0:24255:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790947168.077565:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22777:x1877943593986688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13239us (13522us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1790947168.077578:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790947168.077755:0:22777:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1790947168.077764:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1877943593986688:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790947168.077946:0:22777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1790947168.078563:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947169.104060:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790947169.437748:0:25076:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790947169.437752:0:25076:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790947169.437753:0:25076:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790947169.437920:0:25076:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94b1ef870800 00000020:01000004:0.0:1790947169.437940:0:25076:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790947169.437954:0:25076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790947169.437969:0:25076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94b1c69a8000) 00000020:00000080:0.0:1790947169.437989:0:25076:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790947169.506844:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790947169.508383:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1790947169.508687:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790947169.510009:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790947169.513720:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790947169.514421:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790947169.515681:0:25076:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1790947169.520034:0:25076:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790947169.520263:0:25076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790947169.520277:0:25076:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790947169.520290:0:25076:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6f6b79c2d6dee63 00000020:01000004:2.0:1790947169.520296:0:25076:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790947169.520318:0:25076:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790947169.520321:0:25076:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790947169.520326:0:25076:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790947169.520395:0:25076:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790947169.520399:0:25076:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790947169.535439:0:25076:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790947169.536359:0:25076:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790947169.536363:0:25076:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790947169.536365:0:25076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790947169.536366:0:25076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790947169.536372:0:25076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790947169.536373:0:25076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790947169.536375:0:25076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790947169.536376:0:25076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790947169.536378:0:25076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790947169.536379:0:25076:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790947169.536383:0:25076:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790947169.536385:0:25076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790947169.536386:0:25076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790947169.536387:0:25076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790947169.536388:0:25076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790947169.536389:0:25076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790947169.536390:0:25076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790947169.536391:0:25076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790947169.536392:0:25076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790947169.536393:0:25076:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790947169.536419:0:25076:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790947169.536437:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593986816:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790947169.537431:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.537534:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340840 going to sleep for 11 seconds 00000100:00100000:3.0:1790947169.539275:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986816 00000100:00100000:3.0:1790947169.539289:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986816 00000100:00100000:3.0:1790947169.539410:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790947169.539420:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:25076:x1877943593986816:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790947169.539474:0:22747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790947169.539477:0:22747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1790947169.539481:0:22747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790947169.541573:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:25076:x1877943593986816:12345-0@lo:253:mount.lustre.0 Request processed in 2146us (4136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.541587:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790947169.546542:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593986816:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790947169.546563:0:25076:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790947169.546567:0:25076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790947169.546568:0:25076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790947169.546570:0:25076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790947169.546571:0:25076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790947169.546572:0:25076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790947169.546573:0:25076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790947169.546575:0:25076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790947169.546577:0:25076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790947169.546578:0:25076:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790947169.546676:0:25076:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94b1ef870800 from lustre-OST0001 10000000:01000000:0.0:1790947169.546732:0:25076:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790947169.546736:0:25076:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790947169.546745:0:25076:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94b1fd358000 local copy 00010000:00010000:0.0:1790947169.546756:0:25076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947169.547318:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593986944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947169.547378:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.547462:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947169.547512:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593986944 00000100:00100000:1.0:1790947169.547521:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593986944 00000100:00100000:1.0:1790947169.547607:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790947169.547618:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:25076:x1877943593986944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947169.547706:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:25076:x1877943593986944:12345-0@lo:501:mount.lustre.0 Request processed in 90us (328us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790947169.547714:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790947169.547782:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593986944:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790947169.547796:0:25076:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790947169.547816:0:25076:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790947169.547822:0:25076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.547832:0:25076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c28400/0xe6f6b79c2d6dea9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deaa4 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947169.547875:0:25076:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94b1ef870800 10000000:01000000:0.0:1790947169.547881:0:25076:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790947169.547899:0:25076:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790947169.547902:0:25076:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790947169.547908:0:25076:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790947169.547911:0:25076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790947169.547950:0:25076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.547959:0:25076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.547970:0:25076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947169.547996:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790947169.548021:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.552348:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1790947169.552405:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987072 00000100:00100000:1.0:1790947169.552416:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987072 00000100:00100000:3.0:1790947169.552487:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790947169.552500:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:25076:x1877943593987072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947169.552517:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947169.552536:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1f6c28600/0xe6f6b79c2d6dee71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dee6a expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947169.552565:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c28600/0xe6f6b79c2d6dee71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee6a expref: 22 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947169.552575:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1f6c28600/0xe6f6b79c2d6dee71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee6a expref: 22 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947169.552583:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c28600, rc 0) 00000100:00100000:3.0:1790947169.552652:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987072:12345-0@lo:101:mount.lustre.0 Request processed in 154us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.552658:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790947169.552755:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790947169.552773:0:25076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee71 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.552782:0:25076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dee71 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790947169.554182:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1790947169.554790:0:25076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790947169.556855:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1790947169.557004:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1790947169.557021:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1790947169.557109:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1790947169.557123:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1790947169.557136:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1790947169.557166:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1790947169.557192:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1790947169.557206:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1790947169.557244:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1790947169.557249:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1790947169.557348:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947169.557415:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.557683:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2da6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790947169.557741:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987200 00000100:00100000:1.0:1790947169.557749:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987200 00000100:00100000:1.0:1790947169.557786:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790947169.557793:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947169.558135:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987200:12345-0@lo:501:mount.lustre.0 Request processed in 341us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947169.558143:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790947169.558375:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947169.558408:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790947169.558454:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.558476:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947169.558530:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987328 00000100:00100000:3.0:1790947169.558535:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987328 00000100:00100000:3.0:1790947169.558567:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790947169.558575:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790947169.559356:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987328:12345-0@lo:503:mount.lustre.0 Request processed in 779us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.559381:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790947169.559474:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790947169.559854:0:25076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790947169.560225:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947169.560279:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.560353:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fe2dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.560477:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987456 00000100:00100000:2.0:1790947169.560483:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987456 00000100:00100000:1.0:1790947169.560606:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790947169.560620:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947169.561310:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987456:12345-0@lo:502:mount.lustre.0 Request processed in 693us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947169.561320:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790947169.562461:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947169.562747:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790947169.562778:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1790947169.562802:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1790947169.562818:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1790947169.562830:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1790947169.562843:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1790947169.562855:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1790947169.563102:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1790947169.563119:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1790947169.563158:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947169.563229:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.563328:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c3340840 going to sleep for 11 seconds 00000100:00100000:1.0:1790947169.563373:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987584 00000100:00100000:1.0:1790947169.563380:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987584 00000100:00100000:1.0:1790947169.563464:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790947169.563474:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947169.563584:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987584:12345-0@lo:502:mount.lustre.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947169.563600:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790947169.563671:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947169.563713:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1790947169.563722:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790947169.564849:0:25080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790947169.564903:0:25080:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790947169.564910:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790947169.564912:0:25080:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790947169.564919:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790947169.564935:0:25080:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94b1f6c80000) 00000020:00000080:2.0:1790947169.564960:0:25080:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790947169.564967:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790947169.565203:0:25080:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1ef870800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790947169.565212:0:25080:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790947169.565219:0:25080:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6f6b79c2d6dee7f 00010000:00010000:3.0:1790947169.572428:0:25080:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790947169.573575:0:25080:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1790947169.576426:0:25080:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1790947169.577902:0:25080:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790947169.577914:0:25080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.577920:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.577922:0:25080:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790947169.577925:0:25080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947169.577929:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.577930:0:25080:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790947169.577933:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790947169.577934:0:25080:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790947169.577937:0:25080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.577938:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.577940:0:25080:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790947169.577942:0:25080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947169.577944:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.577945:0:25080:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790947169.577949:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790947169.577975:0:25080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.577978:0:25080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.577979:0:25080:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790947169.577982:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1790947169.580041:0:25076:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790947169.580087:0:25076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790947169.580149:0:25076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee71 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.580163:0:25076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646b400/0xe6f6b79c2d6dee6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee71 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947169.580171:0:25076:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1ef870800 from 1 10000000:01000000:1.0:1790947169.580182:0:25076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790947169.580220:0:25076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.580229:0:25076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.580239:0:25076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947169.580265:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790947169.580327:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.580363:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c6569000 going to sleep for 11 seconds 00000100:00100000:3.0:1790947169.581063:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987712 00000100:00100000:3.0:1790947169.581072:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987712 00000100:00100000:3.0:1790947169.581120:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790947169.581131:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:25076:x1877943593987712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790947169.581145:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947169.581158:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dee86 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947169.581205:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947169.581216:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947169.581224:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c29a00, rc 0) 00000100:00100000:3.0:1790947169.581270:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593987712:12345-0@lo:101:mount.lustre.0 Request processed in 141us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.581276:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790947169.581448:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947169.581465:0:25076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.581474:0:25076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790947169.583569:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790947169.583848:0:25076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947169.584840:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790947169.584912:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790947169.584929:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790947169.584943:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790947169.585012:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790947169.585097:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790947169.585115:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790947169.585129:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790947169.585144:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790947169.585159:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790947169.585183:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790947169.585206:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790947169.585212:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790947169.585303:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947169.585365:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.585411:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ed6300 going to sleep for 11 seconds 00000100:00100000:0.0:1790947169.587043:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987840 00000100:00100000:0.0:1790947169.587055:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987840 00000100:00100000:0.0:1790947169.587110:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790947169.587119:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593987840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790947169.587320:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593987840:12345-0@lo:501:mount.lustre.0 Request processed in 202us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947169.587328:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790947169.587561:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947169.587615:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790947169.587667:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.587704:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c33403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947169.587746:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593987968 00000100:00100000:0.0:1790947169.587750:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593987968 00000100:00100000:0.0:1790947169.587783:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790947169.587789:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593987968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790947169.588062:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593987968:12345-0@lo:503:mount.lustre.0 Request processed in 272us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947169.588077:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790947169.588205:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593987968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790947169.588597:0:25076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790947169.588683:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947169.588721:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.589249:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c33403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947169.596566:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988096 00000100:00100000:3.0:1790947169.596581:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988096 00000100:00100000:3.0:1790947169.596670:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790947169.596680:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593988096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947169.596874:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593988096:12345-0@lo:502:mount.lustre.0 Request processed in 180us (8136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.596882:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790947169.596993:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947169.597251:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1790947169.597285:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1790947169.597299:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1790947169.597313:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1790947169.597325:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1790947169.597337:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1790947169.597350:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1790947169.597363:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1790947169.597377:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1790947169.597388:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1790947169.597399:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1790947169.597433:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947169.597491:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.599791:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c614c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.600146:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988224 00000100:00100000:2.0:1790947169.600156:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988224 00000100:00100000:2.0:1790947169.600220:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790947169.600230:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593988224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947169.600431:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593988224:12345-0@lo:502:mount.lustre.0 Request processed in 203us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.600440:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790947169.602157:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947169.602904:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1790947169.602923:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790947169.606734:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947169.606748:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.606750:0:25084:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790947169.606757:0:25084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b1ef870800 00000020:00000080:3.0:1790947169.606760:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947169.606768:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.606770:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.606771:0:25084:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790947169.606774:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947169.606776:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.606777:0:25084:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790947169.606795:0:25084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94b1ef870800 00000020:00000080:3.0:1790947169.606797:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947169.608607:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.608618:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.608619:0:25084:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790947169.608623:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947169.608627:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.608629:0:25084:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790947169.608634:0:25084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b1ef870800 00000020:00000080:3.0:1790947169.608636:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947169.608678:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.608682:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.608683:0:25084:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790947169.608685:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790947169.608688:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.608689:0:25084:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790947169.608692:0:25084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94b1ef870800 00000020:00000080:3.0:1790947169.608694:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790947169.608731:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790947169.608734:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790947169.608736:0:25084:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790947169.608738:0:25084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1790947169.609557:0:25076:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790947169.609593:0:25076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790947169.609620:0:25076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.609632:0:25076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947169.609687:0:25076:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790947169.609690:0:25076:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94b1ef870800 10000000:01000000:1.0:1790947169.609693:0:25076:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94b1ef870800 10000000:01000000:1.0:1790947169.609703:0:25076:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790947169.609709:0:25076:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94b1ef870800 from 1 10000000:01000000:1.0:1790947169.609712:0:25076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790947169.609748:0:25076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.609757:0:25076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.609768:0:25076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947169.609790:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790947169.609851:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.609921:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ed6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.615077:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988352 00000100:00100000:2.0:1790947169.615092:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988352 00000100:00100000:2.0:1790947169.615151:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790947169.615163:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593988352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790947169.615192:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947169.615212:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef222a00/0xe6f6b79c2d6dee9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6dee94 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.615241:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef222a00/0xe6f6b79c2d6dee9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee94 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.615254:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef222a00/0xe6f6b79c2d6dee9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee94 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.615263:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222a00, rc 0) 00000100:00100000:2.0:1790947169.615340:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988352:12345-0@lo:101:mount.lustre.0 Request processed in 179us (5487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.615356:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790947169.619887:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790947169.619919:0:25076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee9b expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.619931:0:25076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6dee9b expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790947169.621404:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1790947169.621678:0:25076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790947169.621845:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1790947169.621990:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1790947169.622008:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1790947169.622021:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1790947169.622034:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1790947169.622047:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1790947169.622072:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1790947169.622086:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1790947169.622097:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1790947169.622109:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1790947169.622121:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1790947169.622151:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1790947169.622166:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1790947169.622189:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1790947169.622203:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1790947169.622215:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1790947169.622226:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1790947169.622238:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1790947169.622251:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1790947169.622264:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1790947169.622277:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1790947169.622288:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1790947169.622301:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1790947169.622315:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1790947169.622327:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1790947169.622338:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1790947169.622350:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1790947169.622377:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1790947169.622391:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1790947169.622403:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1790947169.622417:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1790947169.622432:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1790947169.622445:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1790947169.622458:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1790947169.622470:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1790947169.622482:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1790947169.622493:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1790947169.622506:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1790947169.622519:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1790947169.622544:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1790947169.622559:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1790947169.622572:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1790947169.622583:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1790947169.622609:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1790947169.622626:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1790947169.622640:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1790947169.622652:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1790947169.622666:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1790947169.622781:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1790947169.622801:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1790947169.622819:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1790947169.622824:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1790947169.627385:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790947169.627463:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.627558:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ed6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.636669:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988480 00000100:00100000:2.0:1790947169.636684:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988480 00000100:00100000:2.0:1790947169.636743:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790947169.636753:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947169.636955:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988480:12345-0@lo:501:mount.lustre.0 Request processed in 203us (9491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.636964:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790947169.642227:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790947169.642382:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790947169.642458:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.642499:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c6569000 going to sleep for 11 seconds 00000100:00100000:1.0:1790947169.642810:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988608 00000100:00100000:1.0:1790947169.642819:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988608 00000100:00100000:2.0:1790947169.642985:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790947169.642996:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790947169.643120:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988608:12345-0@lo:503:mount.lustre.0 Request processed in 126us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.643128:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790947169.643268:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790947169.643677:0:25076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790947169.643801:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947169.643845:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.644076:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988736 00000100:00100000:1.0:1790947169.644082:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988736 00000100:00100000:1.0:1790947169.644122:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790947169.644130:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790947169.645433:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988736:12345-0@lo:502:mount.lustre.0 Request processed in 1295us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947169.645446:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790947169.653542:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c6569000 going to sleep for 11 seconds 00000100:00100000:0.0:1790947169.653742:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947169.654255:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790947169.654287:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1790947169.654302:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1790947169.654313:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1790947169.654328:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1790947169.654339:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1790947169.654621:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1790947169.654854:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1790947169.654899:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790947169.654912:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1790947169.654925:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1790947169.655149:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1790947169.655186:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1790947169.655203:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1790947169.655216:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1790947169.655228:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1790947169.655243:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1790947169.655255:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1790947169.655266:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1790947169.655277:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1790947169.655288:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1790947169.655299:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1790947169.655311:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1790947169.655338:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1790947169.655352:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1790947169.655751:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1790947169.655850:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1790947169.656822:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1790947169.656854:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1790947169.656896:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1790947169.656911:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1790947169.656925:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1790947169.657038:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1790947169.657116:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1790947169.657135:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1790947169.657147:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1790947169.657160:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1790947169.657183:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1790947169.657199:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1790947169.657240:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1790947169.657255:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1790947169.657268:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1790947169.657279:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1790947169.657292:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1790947169.657305:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1790947169.657317:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1790947169.657329:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1790947169.657341:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1790947169.657855:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947169.658115:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.658159:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d0786180 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.658259:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988864 00000100:00100000:2.0:1790947169.658267:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988864 00000100:00100000:2.0:1790947169.658347:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790947169.658402:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790947169.658554:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988864:12345-0@lo:502:mount.lustre.0 Request processed in 155us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.658562:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790947169.658641:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790947169.658825:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790947169.658850:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790947169.659514:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790947169.659567:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.659686:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c6569000 going to sleep for 11 seconds 00000100:00100000:3.0:1790947169.659778:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593988992 00000100:00100000:3.0:1790947169.659784:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593988992 00000100:00100000:3.0:1790947169.659829:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790947169.659838:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790947169.659996:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593988992:12345-0@lo:502:mount.lustre.0 Request processed in 158us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.660011:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790947169.660039:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593988992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790947169.660116:0:25076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1790947169.660126:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790947169.661128:0:25090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790947169.661142:0:25090:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94b1f6c83380) 00000020:00000080:2.0:1790947169.661164:0:25090:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1790947169.661271:0:25090:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1ef870800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790947169.661276:0:25090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1ef870800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790947169.661279:0:25090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1ef870800 3 00010000:00080000:2.0:1790947169.661306:0:25090:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c1089800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1790947169.671735:0:25090:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1790947169.672244:0:25090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790947169.672288:0:25090:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790947169.672300:0:25090:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe6f6b79c2d6deea9 00000100:00080000:2.0:1790947169.672310:0:25090:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790947169.672321:0:25090:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94b0c1089800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947169.672372:0:25090:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c70baa00 x1877943593989120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947169.672401:0:25090:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790947169.672431:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593989120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790947169.672551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1790947169.673649:0:25090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790947169.673666:0:25090:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff94b1ef2e8000) 00000020:00000080:3.0:1790947169.673688:0:25090:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1790947169.673820:0:25090:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94b1ef870800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790947169.673825:0:25090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94b1ef870800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790947169.673828:0:25090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94b1ef870800 3 00010000:00080000:3.0:1790947169.673891:0:25090:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94b0c5ae4000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1790947169.675625:0:25090:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1790947169.675812:0:25090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1790947169.675887:0:25090:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790947169.675898:0:25090:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe6f6b79c2d6deeb7 00000100:00080000:3.0:1790947169.675908:0:25090:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790947169.675919:0:25090:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff94b0c5ae4000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1790947169.675952:0:25090:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b1f707ce00 x1877943593989248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790947169.675994:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1877943593989248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790947169.676059:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790947169.676121:0:25090:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790947169.680434:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989120 00000100:00100000:2.0:1790947169.680448:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989120 00000100:00100000:2.0:1790947169.680527:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989248 00000100:00100000:2.0:1790947169.680531:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989248 00000100:00100000:2.0:1790947169.680556:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790947169.680566:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1877943593989120:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790947169.680594:0:22753:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1790947169.680641:0:22753:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe6f6b79c2d6deebe 00000004:00100000:2.0:1790947169.680656:0:22753:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790947169.680691:0:22753:0:(import.c:65:import_set_state_nolock()) ffff94b0c1089000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947169.680792:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877943593989120:12345-0@lo:38:llog_process_th.0 Request processed in 225us (8240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.680800:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790947169.680819:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790947169.680824:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1877943593989248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790947169.680839:0:22753:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1790947169.680906:0:22753:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe6f6b79c2d6deec5 00000004:00100000:2.0:1790947169.680920:0:22753:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790947169.680942:0:22753:0:(import.c:65:import_set_state_nolock()) ffff94b0c108f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947169.680976:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877943593989248:12345-0@lo:38:llog_process_th.0 Request processed in 151us (4917us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.680984:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790947169.681033:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b1f707ce00 x1877943593989248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790947179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947169.681044:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790947169.681051:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1790947169.681058:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790947169.681063:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790947169.681065:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ae4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790947169.681069:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1877943593989248:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790947169.681087:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c70baa00 x1877943593989120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790947179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947169.681094:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790947169.681097:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1790947169.681102:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790947169.681112:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790947169.681114:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c1089800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790947169.681120:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1877943593989120:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790947169.681732:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790947169.682762:0:25076:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790947169.682799:0:25076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790947169.682825:0:25076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee9b expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.682837:0:25076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b0c7600800/0xe6f6b79c2d6dee94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6dee9b expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790947169.682950:0:25076:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790947169.682953:0:25076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790947169.682954:0:25076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790947169.682961:0:25076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790947169.682962:0:25076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790947169.682964:0:25076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790947169.682965:0:25076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790947169.682967:0:25076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790947169.682968:0:25076:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790947169.682972:0:25076:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790947169.682974:0:25076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790947169.682975:0:25076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790947169.682976:0:25076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790947169.682977:0:25076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790947169.682978:0:25076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790947169.682979:0:25076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790947169.682980:0:25076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790947169.682980:0:25076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790947169.682981:0:25076:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790947169.683004:0:25076:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790947169.683022:0:25076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593989376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790947169.683080:0:25076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.683124:0:25076:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d0786180 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.683134:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989376 00000100:00100000:2.0:1790947169.683142:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989376 00000100:00100000:2.0:1790947169.683194:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790947169.683202:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:25076:x1877943593989376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790947169.683225:0:22747:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790947169.684053:0:22747:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790947169.685932:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790947169.685954:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593989504:0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.686073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.686128:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989504 00000100:00100000:1.0:1790947169.686135:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989504 00000100:00100000:1.0:1790947169.686201:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790947169.686211:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593989504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.686264:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593989504:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947169.686271:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790947169.686329:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593989504:0@lo:400:kworker.0 00000100:00080000:1.0:1790947169.686369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947169.686373:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790947169.686376:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790947169.686380:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1790947169.686384:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790947169.686391:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94b0c774b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947169.686409:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7d3f800 x1877943593989760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790947169.686436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593989632:0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.686453:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593989888:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.686481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.686493:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.686523:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593989760:0@lo:8:kworker.0 00000100:00100000:2.0:1790947169.686554:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.686558:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593990016:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.686586:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989632 00000100:00100000:2.0:1790947169.686591:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989632 00000100:00100000:2.0:1790947169.686627:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989760 00000100:00100000:2.0:1790947169.686630:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989760 00000100:00100000:2.0:1790947169.686642:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790947169.686648:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593989632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.686685:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593989632:12345-0@lo:400:kworker.0 Request processed in 36us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.686692:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790947169.686708:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790947169.686713:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1877943593989760:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790947169.686755:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1877943593989760:12345-0@lo:8:kworker.0 Request processed in 41us (201us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790947169.686769:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790947169.686788:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593989888 00000100:00100000:2.0:1790947169.686791:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593989888 00000100:00100000:2.0:1790947169.686822:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790947169.686829:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593989888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.686887:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593989888:12345-0@lo:400:kworker.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.686894:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1790947169.686913:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947169.686944:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790947169.686951:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1790947169.687247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790947169.687325:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7d3d880 x1877943593989888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947169.687337:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593989888:0@lo:400:kworker.0 00000100:00080000:1.0:1790947169.687372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790947169.687385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790947169.687387:0:37:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790947169.687392:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1790947169.687395:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790947169.687401:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1790947169.687417:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c7d3ed80 x1877943593990272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790947169.687451:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1877943593990528:0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.687479:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947169.687509:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990528 00000100:00100000:1.0:1790947169.687513:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990528 00000100:00100000:1.0:1790947169.687547:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790947169.687555:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877943593990528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.687591:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877943593990528:12345-0@lo:400:kworker.0 Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947169.687598:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790947169.687632:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7d3d180 x1877943593990528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947169.687643:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1877943593990528:0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.687677:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593990656:0@lo:400:kworker.0 00000100:00100000:1.0:1790947169.687698:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790947169.687821:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790947169.687827:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593989760:0@lo:8:kworker.0 00000100:00100000:2.0:1790947169.687843:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593990272:0@lo:8:kworker.0 00000100:00100000:2.0:1790947169.687898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790947169.687927:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790947169.687939:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593990400:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.688282:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593989632:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688295:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790947169.688301:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593990144:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688329:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947169.688369:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990656 00000100:00100000:2.0:1790947169.688373:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990656 00000100:00100000:2.0:1790947169.688407:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990400 00000100:00100000:2.0:1790947169.688410:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990400 00000100:00100000:2.0:1790947169.688441:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790947169.688448:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593990656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688499:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877943593990656:12345-0@lo:400:kworker.0 Request processed in 51us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.688506:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790947169.688520:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790947169.688526:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593990400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688569:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943593990400:12345-0@lo:400:kworker.0 Request processed in 44us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.688574:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790947169.688603:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7e74380 x1877943593990656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947169.688613:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1877943593990656:0@lo:400:kworker.0 00000100:00080000:2.0:1790947169.688625:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790947169.688638:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94b0c7d3d500 x1877943593990400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790947169.688646:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943593990400:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688670:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990272 00000100:00100000:2.0:1790947169.688673:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990272 00000100:00100000:2.0:1790947169.688690:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990144 00000100:00100000:2.0:1790947169.688692:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990144 00000100:00100000:2.0:1790947169.688722:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790947169.688729:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593990144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.688763:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593990144:12345-0@lo:400:kworker.0 Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947169.688770:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790947169.688793:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790947169.688797:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1877943593990272:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790947169.688844:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1877943593990272:12345-0@lo:8:kworker.0 Request processed in 45us (946us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790947169.688850:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790947169.688891:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947169.688915:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593990144:0@lo:400:kworker.0 00000100:00100000:2.0:1790947169.689149:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790947169.689156:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790947169.689160:0:3638:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790947169.689165:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593990272:0@lo:8:kworker.0 20000000:01000000:2.0:1790947169.691208:0:22747:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790947169.691230:0:22747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790947169.691372:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790947169.691377:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790947169.691398:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.691428:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 24 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.691437:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.691445:0:22768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.691489:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.691520:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 24 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947169.691534:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593990784:0@lo:104: 00000100:00100000:2.0:1790947169.692405:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790947169.692482:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 24 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.692493:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 24 pid: 22747 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947169.692504:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593990912:0@lo:104: 00000100:00100000:2.0:1790947169.692531:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947169.692920:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990016 00000100:00100000:3.0:1790947169.692929:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990016 00000100:00100000:3.0:1790947169.692981:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790947169.692991:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593990016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947169.693057:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593990016:12345-0@lo:400:kworker.0 Request processed in 67us (5810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.693071:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790947169.696370:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef20d180 going to sleep for 11 seconds 00000100:00100000:2.0:1790947169.696425:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593990016:0@lo:400:kworker.0 00000100:00100000:0.0:1790947169.696839:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990784 00000100:00100000:0.0:1790947169.696847:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990784 00000100:00100000:0.0:1790947169.696902:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593990912 00000100:00100000:0.0:1790947169.696905:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593990912 00000100:00100000:0.0:1790947169.696921:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790947169.696929:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:22768:x1877943593990784:12345-0@lo:104: 00010000:00010000:0.0:1790947169.696946:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697022:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790947169.697028:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:22768:x1877943593990784:12345-0@lo:104: Request processed in 101us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947169.697036:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790947169.697054:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790947169.697069:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593990912:12345-0@lo:104: 00010000:00010000:0.0:1790947169.697078:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697116:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790947169.697120:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:22768:x1877943593990912:12345-0@lo:104: Request processed in 52us (4589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947169.697125:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790947169.697142:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947169.697148:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697155:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222000 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947169.697159:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697168:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947169.697186:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947169.697191:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790947169.697224:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697231:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947169.697249:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697266:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1ef222000/0xe6f6b79c2d6ded67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded6e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697278:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947169.697281:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697286:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a000 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:0.0:1790947169.697289:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697295:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790947169.697300:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947169.697305:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790947169.697317:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697323:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790947169.697330:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697336:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646a000/0xe6f6b79c2d6ded59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded60 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697348:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947169.697354:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947169.697356:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947169.697376:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593991040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947169.697415:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.697443:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790947169.697449:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593991168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947169.697469:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947169.697492:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991040 00000100:00100000:0.0:1790947169.697496:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991040 00010000:00010000:0.0:1790947169.697512:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 25 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947169.697532:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991168 00000100:00100000:0.0:1790947169.697534:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991168 00010000:00010000:0.0:1790947169.697546:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 26 pid: 22747 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947169.697560:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790947169.697566:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+26:3641:x1877943593991040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947169.697575:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790947169.697580:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 26 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697589:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 26 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697679:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790947169.697713:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+26:3641:x1877943593991040:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947169.697722:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1790947169.697735:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223e00/0xe6f6b79c2d6ded6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded67 expref: 26 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947169.697745:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790947169.697753:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3641:x1877943593991168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947169.697761:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790947169.697762:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593990784:0@lo:104: 00010000:00010000:0.0:1790947169.697768:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 24 pid: 22747 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947169.697781:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1877943593990912:0@lo:104: 00010000:00010000:0.0:1790947169.697782:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 24 pid: 22747 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697799:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef222c00/0xe6f6b79c2d6ded60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded59 expref: 24 pid: 22747 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.697808:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697812:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.697828:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947169.697876:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947169.698181:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:25076:x1877943593989376:12345-0@lo:253:mount.lustre.0 Request processed in 14968us (15089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947169.698192:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790947169.698287:0:25076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:25076:1877943593989376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790947169.698297:0:25076:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790947169.698309:0:25076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790947169.698311:0:25076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790947169.698312:0:25076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790947169.698313:0:25076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790947169.698314:0:25076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790947169.698315:0:25076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790947169.698317:0:25076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790947169.698319:0:25076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790947169.698320:0:25076:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790947169.698331:0:25076:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1790947169.700210:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008830967s 00010000:00010000:0.0:1790947169.700223:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700233:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700239:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700246:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700251:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222800 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947169.700263:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700271:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700301:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947169.700314:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790947169.700699:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.700708:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947169.700721:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef222800/0xe6f6b79c2d6deecc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947169.700823:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:3641:x1877943593991168:12345-0@lo:103:ldlm_bl.0 Request processed in 3067us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947169.700833:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790947169.700914:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593991168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790947169.700925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943593991040:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1790947169.702734:0:25076:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1790947169.714776:0:25076:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790947169.714787:0:25076:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790947169.714825:0:25076:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790947169.715069:0:25076:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790947169.715092:0:25076:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790947169.715124:0:25076:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790947169.716132:0:25076:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790947169.716375:0:25076:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1790947169.936190:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790947170.126096:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790947170.649421:0:25145:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790947170.649664:0:25145:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1790947170.958039:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790947170.958048:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b0c7116800 from 14 10000000:01000000:0.0:1790947170.958055:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790947170.958108:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947170.958121:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947170.958152:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947170.958193:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947170.958270:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947170.958321:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c614b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947170.958759:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991296 00000100:00100000:2.0:1790947170.958768:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991296 00000100:00100000:2.0:1790947170.958823:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790947170.958832:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943593991296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947170.958845:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947170.959174:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef222200/0xe6f6b79c2d6deeda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deed3 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.960157:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef222200/0xe6f6b79c2d6deeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deed3 expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.960226:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef222200/0xe6f6b79c2d6deeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deed3 expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.960236:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222200, rc 0) 00000100:00100000:1.0:1790947170.960424:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943593991296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1592us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947170.960433:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790947170.960519:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790947170.960539:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deeda expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947170.960548:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deeda expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947170.960619:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790947170.960657:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947170.960757:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c614b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790947170.960796:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991424 00000100:00100000:3.0:1790947170.960802:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991424 00000100:00100000:3.0:1790947170.960902:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790947170.960912:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943593991424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790947170.960929:0:22747:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790947170.960945:0:22747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790947170.960948:0:22747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1790947170.961038:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943593991424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947170.961045:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790947170.961097:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790947170.961147:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790947170.961153:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deeda expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.961161:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1c646a600/0xe6f6b79c2d6deed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deeda expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947170.961200:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790947170.961202:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94b1fcde2000 from 14 10000000:01000000:1.0:1790947170.961205:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790947170.961226:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.961232:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.961240:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947170.961251:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790947170.961273:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947170.961579:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1e1e6a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947170.961648:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991552 00000100:00100000:0.0:1790947170.961654:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991552 00000100:00100000:0.0:1790947170.961679:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790947170.961685:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943593991552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790947170.961695:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947170.961706:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c646ae00/0xe6f6b79c2d6deee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6deee1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947170.961722:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c646ae00/0xe6f6b79c2d6deee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deee1 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947170.961744:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c646ae00/0xe6f6b79c2d6deee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deee1 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947170.961752:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c646ae00, rc 0) 00000100:00100000:0.0:1790947170.961792:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943593991552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947170.961798:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790947170.961940:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790947170.961953:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deee8 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.961961:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6deee8 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947170.962008:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790947170.962039:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947170.962052:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1e1e6a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947170.962094:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991680 00000100:00100000:0.0:1790947170.962098:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991680 00000100:00100000:0.0:1790947170.962337:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790947170.962345:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943593991680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790947170.962356:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790947170.962386:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790947170.962389:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1790947170.962462:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943593991680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947170.962469:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790947170.962587:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943593991680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790947170.962638:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790947170.962649:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deee8 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947170.962657:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b0c7601600/0xe6f6b79c2d6deee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6deee8 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947171.151659:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947172.046788:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790947172.046811:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593991808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790947172.046910:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947172.047220:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991808 00000100:00100000:2.0:1790947172.047228:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991808 00000100:00100000:2.0:1790947172.047284:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790947172.047294:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593991808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790947172.047323:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790947172.047375:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593991808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947172.047382:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790947172.047432:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593991808:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790947172.047517:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790947172.174559:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947173.070986:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790947173.071007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593991936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790947173.071078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947173.071140:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593991936 00000100:00100000:1.0:1790947173.071383:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593991936 00000100:00100000:1.0:1790947173.071444:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790947173.071454:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593991936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790947173.071489:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790947173.071593:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593991936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947173.071601:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790947173.071645:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593991936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790947173.072403:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593992064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790947173.072442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947173.072474:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790947173.072480:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593992192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947173.072522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947173.072686:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992064 00000100:00100000:2.0:1790947173.072692:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992064 00000100:00100000:2.0:1790947173.072741:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790947173.072749:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593992064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790947173.072763:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790947173.072801:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593992064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947173.072814:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790947173.072974:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992192 00000100:00100000:3.0:1790947173.072978:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992192 00000100:00100000:3.0:1790947173.073005:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790947173.073012:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593992192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790947173.073034:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790947173.073068:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593992192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947173.073075:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1790947173.073135:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790947173.073177:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593992192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790947173.073191:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593992064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790947173.205651:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947174.222114:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790947174.546246:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1790947175.118026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947175.118033:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790947175.118036:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947175.118052:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94b0c774b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947175.118073:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c70bbb80 x1877943593992704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790947175.118107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790947175.118110:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790947175.118112:0:8:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790947175.118118:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94b1f4132000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1790947175.118127:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94b0c77e0700 x1877943593993216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790947175.118150:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593992320:0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.118182:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593992448:0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.118239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.118249:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.118279:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593992960:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.118302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.118339:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943593993600:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.118362:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.118527:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877943593992832:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.118552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947175.122656:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593993088:0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.122798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947175.122850:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1877943593993728:0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.123013:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593992576:0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.123039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947175.123059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593993344:0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.123085:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593992704:0@lo:8:kworker.0 00000100:00100000:2.0:1790947175.123123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947175.123479:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593993216:0@lo:8:kworker.0 00000100:00100000:2.0:1790947175.123503:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947175.123544:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992448 00000100:00100000:2.0:1790947175.123552:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992448 00000100:00100000:2.0:1790947175.123596:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992960 00000100:00100000:2.0:1790947175.123600:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992960 00000100:00100000:2.0:1790947175.123616:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790947175.123623:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593992448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.123678:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593992448:12345-0@lo:400:kworker.0 Request processed in 55us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947175.123686:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790947175.123707:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790947175.123714:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593992960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.123965:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593992960:12345-0@lo:400:kworker.0 Request processed in 251us (5660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947175.123972:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790947175.123991:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993088 00000100:00100000:2.0:1790947175.123995:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993088 00000100:00100000:2.0:1790947175.124024:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992576 00000100:00100000:2.0:1790947175.124027:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992576 00000100:00100000:2.0:1790947175.124037:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992704 00000100:00100000:2.0:1790947175.124039:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992704 00000100:00100000:2.0:1790947175.124045:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993216 00000100:00100000:2.0:1790947175.124047:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993216 00000100:00100000:2.0:1790947175.124055:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790947175.124060:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593993088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.124092:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593993088:12345-0@lo:400:kworker.0 Request processed in 31us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947175.124105:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790947175.124116:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790947175.124121:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593992576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947175.124166:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593992576:12345-0@lo:400:kworker.0 Request processed in 44us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947175.124171:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790947175.124182:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790947175.124185:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1877943593992704:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790947175.124209:0:24665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:2.0:1790947175.124234:0:24665:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6f6b79c2d6deeef 00002000:00100000:2.0:1790947175.124247:0:24665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94b0c108b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790947175.124251:0:24665:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790947175.124253:0:24665:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790947175.124505:0:24665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790947175.124530:0:24665:0:(import.c:65:import_set_state_nolock()) ffff94b0c108a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947175.124569:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1877943593992704:12345-0@lo:8:kworker.0 Request processed in 381us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947175.124575:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790947175.124587:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790947175.124592:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1877943593993216:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790947175.124607:0:24665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:2.0:1790947175.124623:0:24665:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6f6b79c2d6deef6 00002000:00100000:2.0:1790947175.124629:0:24665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff94b0c1088800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790947175.124633:0:24665:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1790947175.124640:0:24665:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790947175.124662:0:24665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790947175.124674:0:24665:0:(import.c:65:import_set_state_nolock()) ffff94b0c108b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947175.124704:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3638:x1877943593993216:12345-0@lo:8:kworker.0 Request processed in 111us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947175.124710:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790947175.125542:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593992960:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.125573:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992320 00000100:00100000:1.0:1790947175.125578:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992320 00000100:00100000:1.0:1790947175.125615:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790947175.125623:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943593992320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.125666:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943593992320:12345-0@lo:400:kworker.0 Request processed in 43us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.125672:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1790947175.125696:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790947175.125708:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593992320:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.125728:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593993472:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.125761:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947175.127269:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993600 00000100:00100000:0.0:1790947175.127280:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993600 00000100:00100000:0.0:1790947175.127460:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593992832 00000100:00100000:0.0:1790947175.127464:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593992832 00000100:00100000:0.0:1790947175.127487:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790947175.127495:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943593993600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.127635:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943593993600:12345-0@lo:400:kworker.0 Request processed in 140us (9271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947175.127642:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790947175.127657:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790947175.127663:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877943593992832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.127688:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877943593992832:12345-0@lo:400:kworker.0 Request processed in 26us (9135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947175.127694:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790947175.127713:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790947175.127750:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7c80380 x1877943593993600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947175.127764:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943593993600:0@lo:400:kworker.0 00010000:00080000:2.0:1790947175.128038:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c70bbb80 x1877943593992704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790947200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790947175.128053:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790947175.128060:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790947175.128066:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790947175.128069:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b0c774b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790947175.128087:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790947175.128094:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1877943593992704:0@lo:8:kworker.0 00010000:00080000:2.0:1790947175.128109:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c77e0700 x1877943593993216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790947200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790947175.128118:0:3638:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790947175.128122:0:3638:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790947175.128125:0:3638:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790947175.128127:0:3638:0:(import.c:65:import_set_state_nolock()) ffff94b1f4132000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790947175.128151:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790947175.128154:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1877943593993216:0@lo:8:kworker.0 00000004:00080000:2.0:1790947175.128177:0:23496:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790947175.128263:0:23496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671209404048ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790947175.128270:0:23496:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1790947175.128351:0:22778:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790947175.128510:0:22778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671209650295ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790947175.128515:0:22778:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1790947175.129226:0:22779:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1790947175.129249:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1877943593994112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790947175.129303:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947175.129771:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41180 going to sleep for 11 seconds 00000004:00080000:2.0:1790947175.134346:0:22732:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790947175.138081:0:23497:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790947175.138111:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1877943593994368:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790947175.138179:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.138201:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d89fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1790947175.145677:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994112 00000100:00100000:1.0:1790947175.145692:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994112 00000100:00100000:1.0:1790947175.145759:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994368 00000100:00100000:1.0:1790947175.145763:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994368 00000100:00100000:2.0:1790947175.145784:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790947175.145794:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790947175.145796:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22779:x1877943593994112:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790947175.145800:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23497:x1877943593994368:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790947175.146068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.146156:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593992448:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.146188:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593993088:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.146205:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790947175.146217:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593994240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790947175.146266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.146295:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993472 00000100:00100000:1.0:1790947175.146300:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993472 00000100:00100000:1.0:1790947175.146329:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993728 00000100:00100000:1.0:1790947175.146332:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993728 00000100:00100000:1.0:1790947175.146352:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790947175.146358:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593993472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.146413:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943593993472:12345-0@lo:400:kworker.0 Request processed in 54us (20651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.146420:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790947175.146435:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790947175.146441:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877943593993728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.146471:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877943593993728:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.146477:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790947175.146496:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994240 00000100:00100000:1.0:1790947175.146500:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994240 00000100:00100000:1.0:1790947175.146521:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790947175.146527:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1877943593994240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790947175.146544:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790947175.146574:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1877943593994240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.146580:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790947175.146623:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7d3f800 x1877943593994240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.146639:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593994240:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1790947175.146652:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7c81180 x1877943593993728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.146660:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1877943593993728:0@lo:400:kworker.0 00010000:00080000:1.0:1790947175.146686:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c77e1c00 x1877943593993472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.146694:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943593993472:0@lo:400:kworker.0 00000100:00100000:1.0:1790947175.146707:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593993984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790947175.146732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.146752:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993984 00000100:00100000:1.0:1790947175.146755:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993984 00000100:00100000:1.0:1790947175.146774:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790947175.146780:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1877943593993984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790947175.146788:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790947175.146812:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1877943593993984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.146817:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790947175.146840:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7f08a80 x1877943593993984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.146852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593993984:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790947175.146886:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c70bad80 x1877943593992832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.146908:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877943593992832:0@lo:400:kworker.0 00000100:00080000:1.0:1790947175.146967:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790947175.146972:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790947175.154616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947175.154675:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993344 00000100:00100000:0.0:1790947175.154684:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993344 00000100:00100000:0.0:1790947175.154733:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790947175.154744:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593993344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.154816:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877943593993344:12345-0@lo:400:kworker.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947175.154823:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1790947175.154879:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c77e3800 x1877943593993344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947175.154893:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877943593993344:0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.154904:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1877943593993856:0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.154941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947175.154963:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593993856 00000100:00100000:0.0:1790947175.154967:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593993856 00000100:00100000:0.0:1790947175.155001:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790947175.155007:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877943593993856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.155036:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877943593993856:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947175.155043:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790947175.155058:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790947175.155077:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7c81c00 x1877943593993856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947175.155085:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1877943593993856:0@lo:400:kworker.0 00000100:00100000:0.0:1790947175.155120:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593992576:0@lo:400:kworker.0 00002000:00080000:1.0:1790947175.169157:0:24259:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790947175.169168:0:24259:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790947175.169262:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23497:x1877943593994368:12345-0@lo:7:osp-pre-1-1.0 Request processed in 23457us (31077us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.169272:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1790947175.169464:0:23497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7d3d180 x1877943593994368/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790947191 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.169479:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1877943593994368:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1790947175.169492:0:23497:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790947175.169601:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1877943593994496:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1790947175.169638:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.169662:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d89fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1790947175.169681:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994496 00000100:00100000:1.0:1790947175.169687:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994496 00000100:00100000:1.0:1790947175.169723:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790947175.169731:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23497:x1877943593994496:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1790947175.169758:0:24261:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1790947175.169786:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23497:x1877943593994496:12345-0@lo:5:osp-pre-1-1.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.169792:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790947175.169815:0:23497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c7d3d180 x1877943593994496/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790947191 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.169837:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1877943593994496:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790947175.170953:0:23497:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790947175.171002:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1877943593994624:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790947175.171776:0:23485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1790947175.171978:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947175.172004:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d89fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1790947175.172460:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994624 00000100:00100000:1.0:1790947175.172468:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994624 00000100:00100000:1.0:1790947175.173167:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790947175.173179:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23497:x1877943593994624:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1790947175.173220:0:24665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:2.0:1790947175.182881:0:24260:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790947175.183992:0:24260:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1790947175.184002:0:24260:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00010000:0.0:1790947175.208748:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.208759:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208775:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.208779:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.208785:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208803:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208813:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208822:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208840:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.208851:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.208871:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208901:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646ba00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.208906:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208914:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208929:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208937:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6deefd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.208954:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.208956:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.208958:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.210846:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.210875:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.210904:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.210909:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.210915:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.210928:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.210949:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.210958:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.210982:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790947175.211809:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947175.211826:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.211837:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947175.211842:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.211885:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.211906:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.211913:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.211936:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.211937:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.211939:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790947175.212098:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790947175.212105:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212115:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1790947175.212119:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947175.212123:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212155:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212164:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212171:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212191:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790947175.212619:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790947175.212626:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212635:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1790947175.212638:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947175.212642:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212651:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212658:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212676:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212693:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790947175.212705:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947175.212709:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212717:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947175.212721:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212730:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212743:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.212743:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.212752:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212754:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c851c09a/0xe6f6b79c2d6def0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.212773:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29400 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.212778:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.212783:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.212786:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.212789:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.212789:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.212805:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.212813:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d68bb1ae/0xe6f6b79c2d6def12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.212830:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.212839:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.212841:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790947175.213325:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790947175.213336:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213344:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1790947175.213346:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947175.213349:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213355:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213360:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213365:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213374:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790947175.213380:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947175.213383:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213387:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13ce600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947175.213390:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213394:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213406:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213411:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061cb7b0a/0xe6f6b79c2d6def19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.213421:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.213422:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.213423:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.214687:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.214697:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.214713:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.214717:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.214722:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.214734:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.214743:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.214751:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.214774:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790947175.215216:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947175.215223:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.215232:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947175.215236:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.215246:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.215261:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.215269:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c626120/0xe6f6b79c2d6def20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.215299:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.215301:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.215304:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.215645:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.215652:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215663:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.215666:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.215672:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215689:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215697:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215704:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215719:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.215726:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.215730:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215737:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.215741:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215749:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215760:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215767:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096cc5460/0xe6f6b79c2d6def27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.215789:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.215790:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.215792:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.216499:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.216507:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216518:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.216521:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.216526:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216537:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216545:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216553:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216569:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947175.216873:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.216880:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216898:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.216901:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.216905:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216915:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216922:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216930:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.216944:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790947175.217274:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.217281:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217290:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.217294:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.217298:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217377:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217397:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217405:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217420:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790947175.217429:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790947175.217434:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217442:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a800 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.217446:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217455:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217468:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217476:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b8708f/0xe6f6b79c2d6def2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217493:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947175.217504:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217510:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.217514:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217521:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217532:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217538:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5bde159/0xe6f6b79c2d6def35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217551:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.217554:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217560:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.217563:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217570:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217592:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217599:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a19850b4/0xe6f6b79c2d6def3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.217611:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.217613:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.217615:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.219013:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.219023:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.219049:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.219053:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.219058:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.219070:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.219079:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.219088:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.219122:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947175.219323:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947175.219331:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.219339:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b800 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947175.219344:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.219353:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.219371:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.219379:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.219398:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.219401:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.219402:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.220630:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.220640:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.220654:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1790947175.220655:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.220661:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947175.220663:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.220667:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.220679:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.220689:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.220697:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.220714:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947175.221117:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.221124:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221143:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.221154:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.221159:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221170:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221179:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221187:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221204:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790947175.221213:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947175.221218:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221226:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646ba00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.221231:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221240:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221256:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221278:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043d251ea/0xe6f6b79c2d6def4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.221297:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.221301:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.222114:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.222471:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646a000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.222477:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.222487:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.222503:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.222510:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007808c5f3/0xe6f6b79c2d6def51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.222528:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.222530:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.222532:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.224426:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.224441:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.224466:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.224471:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.224477:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.224491:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.224501:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.224509:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.224528:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947175.225221:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.225229:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225238:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.225241:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.225245:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225253:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225271:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225278:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225307:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790947175.225701:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.225708:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225716:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.225719:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.225723:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225733:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225741:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225748:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225774:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790947175.225783:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790947175.225788:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225796:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646b800 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.225801:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225811:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225826:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.225834:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c606c67/0xe6f6b79c2d6def58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.226005:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790947175.226012:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.226038:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947175.226042:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.226051:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.226064:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.226071:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d80640/0xe6f6b79c2d6def5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.226232:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947175.227255:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.227260:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.227262:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.229477:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.229483:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.229486:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.230956:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.230968:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.230981:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24600 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947175.230986:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.230997:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.231019:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.231038:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcc8c93e/0xe6f6b79c2d6def66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.231058:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.231060:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.231063:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.231068:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.231069:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.232191:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.232204:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232221:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.232233:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.232241:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232255:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232265:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232274:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232296:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.232480:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.232487:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232496:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.232500:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232510:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232525:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232546:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.232571:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.232574:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.232577:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.234514:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.234524:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.234539:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.234544:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.234549:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.234561:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.234570:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.234578:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.234604:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947175.235215:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947175.235223:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.235231:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947175.235236:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.235245:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.235261:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.235268:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159fa54b/0xe6f6b79c2d6def74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.235291:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.235301:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.235371:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.236264:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.236279:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.236292:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.236296:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.236301:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.236418:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.236429:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.236437:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.236485:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790947175.238245:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.238258:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.238274:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.238279:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.238284:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.238298:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.238326:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.238334:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.241179:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947175.241194:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.241210:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947175.241215:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.241227:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.241250:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.241258:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6def7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.241327:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947175.241334:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.241344:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947175.241348:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.241357:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.241370:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947175.241378:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.241379:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.241381:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.241446:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790947175.241455:0:24260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6def82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.241636:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.244232:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.244246:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.244264:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.244269:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.244275:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.244290:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.244301:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.244323:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.244351:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947175.244385:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947175.244394:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.244406:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947175.244411:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.244422:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.244447:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.244455:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0420ba3/0xe6f6b79c2d6def89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.244474:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.244477:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.244479:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947175.246335:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947175.247847:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.247875:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.247893:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.247898:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.247904:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.247937:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.247947:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.247955:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790947175.248253:0:25077:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1790947175.248285:0:25077:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1790947175.248290:0:25077:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790947175.248293:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790947175.248455:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23497:x1877943593994624:12345-0@lo:5:osp-pre-1-1.0 Request processed in 75276us (76475us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1790947175.248465:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790947175.248514:0:23497:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1790947175.248521:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1877943593994624:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790947175.248536:0:23497:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1790947175.248644:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23497:1877943593994752:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790947175.248683:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947175.248777:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d89fa000 going to sleep for 11 seconds 00010000:00010000:0.0:1790947175.254766:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.254779:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.254793:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601400 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.254798:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.254810:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.254831:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.254839:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e61a0203/0xe6f6b79c2d6def90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947175.258033:0:22763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994752 00000100:00100000:1.0:1790947175.258048:0:22763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994752 00000100:00100000:1.0:1790947175.258101:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790947175.258111:0:22763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23497:x1877943593994752:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790947175.258217:0:22763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23497:x1877943593994752:12345-0@lo:900:osp-pre-1-1.0 Request processed in 108us (9535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947175.258225:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790947175.258269:0:23497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1f707d180 x1877943593994752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790947191 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790947175.258284:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23497:1877943593994752:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1790947175.258399:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.258408:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.258432:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.258436:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.258437:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.258441:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.258443:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.258451:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.258466:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.258477:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.258485:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.258510:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.258744:0:25346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.258757:0:25346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.258767:0:25346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.258772:0:25346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.258781:0:25346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.258799:0:25346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.258806:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4e5d0d/0xe6f6b79c2d6def97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.258822:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.258824:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.258825:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947175.260245:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.260260:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.260276:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.260280:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.260286:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.260299:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.260321:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.260330:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.260353:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790947175.261129:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.261146:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261158:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.261162:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.261167:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261178:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261186:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261194:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261221:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790947175.261230:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790947175.261236:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261243:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947175.261248:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261259:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.261271:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947175.261274:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.261279:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261285:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5a07858/0xe6f6b79c2d6def9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.261298:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.261303:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.261309:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.261312:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.261314:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.262235:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262252:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262260:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008907c0a5/0xe6f6b79c2d6defa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790947175.262263:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.262275:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262286:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.262287:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.262289:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.262292:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.262299:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.262304:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.262315:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.262325:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.262332:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.262345:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.262879:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.262886:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262895:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.262900:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262909:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262922:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262940:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a70b057c/0xe6f6b79c2d6defac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.262955:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.262957:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.262958:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947175.265361:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.265376:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.265393:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.265397:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.265403:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.265417:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.265427:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.265442:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.265460:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.266671:0:25346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.266684:0:25346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.266697:0:25346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.266703:0:25346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.266714:0:25346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.266734:0:25346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.266743:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000970ea3ff/0xe6f6b79c2d6defb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.266764:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.266766:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.266769:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947175.268692:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.268704:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.268781:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.268786:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.268793:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.268808:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.269055:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.269065:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.269087:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790947175.269117:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947175.269125:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.269144:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601a00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:2.0:1790947175.269149:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.269159:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.269176:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.269183:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb02173/0xe6f6b79c2d6defba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947175.269215:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.269216:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947175.269218:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790947175.270082:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.270090:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.270109:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.270113:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.270118:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.270129:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.270148:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.270156:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.270210:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790947175.272314:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790947175.272328:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.272345:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1790947175.272350:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947175.272356:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.272370:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.272398:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.272408:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274663:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790947175.274677:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274690:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.274695:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274706:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274740:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274747:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b3561e/0xe6f6b79c2d6defc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274772:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.274775:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274782:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601c00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.274785:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274792:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274829:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.274839:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.274841:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.274852:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.275233:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790947175.275241:0:24260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a968033e/0xe6f6b79c2d6defc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.275526:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.276142:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.276150:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276164:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.276169:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.276175:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276187:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276196:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276204:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276221:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790947175.276346:0:25346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790947175.276352:0:25346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276360:0:25346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25200 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947175.276364:0:25346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276374:0:25346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276388:0:25346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276394:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d85d4657/0xe6f6b79c2d6defcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276410:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.276412:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947175.276413:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790947175.276622:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790947175.276628:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276637:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1790947175.276640:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947175.276645:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276666:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276675:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276682:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947175.276750:0:24260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790947175.277199:0:24260:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1790947175.277288:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22779:x1877943593994112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 131490us (147979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947175.277298:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790947175.277355:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1877943593994112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790947175.277370:0:22779:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1790947175.277411:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1877943593994880:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790947175.277441:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947175.277463:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1fcd17b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790947175.277479:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593994880 00000100:00100000:0.0:1790947175.277484:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593994880 00000100:00100000:0.0:1790947175.277521:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790947175.277529:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22779:x1877943593994880:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790947175.277563:0:24260:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1790947175.284638:0:24994:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947175.284651:0:24994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.284667:0:24994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25000 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947175.284672:0:24994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.284683:0:24994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.284705:0:24994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.284714:0:24994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ac25d75/0xe6f6b79c2d6defd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947175.284807:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.285157:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947175.285161:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947175.285687:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22779:x1877943593994880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8155us (8241us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1790947175.285698:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790947175.286111:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1877943593994880:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790947175.286128:0:22779:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1790947176.275283:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790947177.052651:0:25436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790947177.173600:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593995008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790947177.173699:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947177.173789:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995008 00000100:00100000:3.0:1790947177.173796:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995008 00000100:00100000:3.0:1790947177.173891:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790947177.173901:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593995008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790947177.173929:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947177.173988:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593995008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947177.173995:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1790947177.174096:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947177.174146:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593995008:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790947177.303302:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790947177.963515:0:25488:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790947177.963738:0:25488:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790947178.190119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593995136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790947178.190313:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947178.190490:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995136 00000100:00100000:1.0:1790947178.190499:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995136 00000100:00100000:1.0:1790947178.190553:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790947178.190563:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593995136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790947178.190601:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790947178.190676:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593995136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947178.190683:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790947178.190738:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593995136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947178.192999:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593995264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947178.193067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947178.193133:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995264 00000100:00100000:3.0:1790947178.193141:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995264 00000100:00100000:3.0:1790947178.193204:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790947178.193213:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593995264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790947178.193235:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947178.193278:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593995264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947178.193291:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790947178.193323:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790947178.193528:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593995264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790947178.193674:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790947178.193684:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593995392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790947178.193965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947178.194072:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995392 00000100:00100000:1.0:1790947178.194079:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995392 00000100:00100000:1.0:1790947178.194168:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790947178.194177:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593995392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790947178.194207:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790947178.194256:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593995392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947178.194263:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790947178.194335:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593995392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790947178.318053:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790947178.831596:0:25538:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790947178.832210:0:25538:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1790947179.150899:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790947179.183191:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947179.183278:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573952896 00000100:00100000:2.0:1790947179.183288:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573952896 00000100:00100000:2.0:1790947179.183337:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:2.0:1790947179.183346:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1877943573952896:12345-192.168.203.29@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790947179.183374:0:22746:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bce661d0-1e50-4766-a156-91ae28874164@192.168.203.29@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1790947179.183402:0:22746:0:(genops.c:1384:class_connect()) connect: client bce661d0-1e50-4766-a156-91ae28874164, cookie 0xe6f6b79c2d6defdd 00000100:00080000:2.0:1790947179.183533:0:22746:0:(import.c:65:import_set_state_nolock()) ffff94b0c108c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947179.183778:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+5:2401:x1877943573952896:12345-192.168.203.29@tcp:250:mount.lustre.0 Request processed in 430us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947179.183808:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:1.0:1790947179.189657:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.190005:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953024 00000100:00100000:0.0:1790947179.190020:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953024 00000100:00100000:0.0:1790947179.190093:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:0.0:1790947179.190112:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+5:18029:x1877943573953024:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790947179.190135:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947179.190158:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b0c7e25c00/0xe6f6b79c2d6defe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f049 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947179.190195:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b0c7e25c00/0xe6f6b79c2d6defe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f049 expref: 6 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947179.190208:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b0c7e25c00/0xe6f6b79c2d6defe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f049 expref: 6 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947179.190219:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e25c00, rc 0) 00000100:00100000:0.0:1790947179.190295:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+6:18029:x1877943573953024:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 193us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.190302:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:3.0:1790947179.193561:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947179.193935:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953152 00000100:00100000:2.0:1790947179.193948:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953152 00000100:00100000:2.0:1790947179.194022:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:2.0:1790947179.194033:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+6:18029:x1877943573953152:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790947179.194208:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+6:18029:x1877943573953152:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 176us (662us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790947179.194217:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:3.0:1790947179.196631:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.196838:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953280 00000100:00100000:1.0:1790947179.196851:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953280 00000100:00100000:1.0:1790947179.196958:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:1.0:1790947179.196988:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+6:18029:x1877943573953280:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790947179.197012:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947179.197036:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b0c7600e00/0xe6f6b79c2d6defeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f050 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.197071:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b0c7600e00/0xe6f6b79c2d6defeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f050 expref: 7 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.197084:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b0c7600e00/0xe6f6b79c2d6defeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f050 expref: 7 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.197094:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600e00, rc 0) 00000100:00100000:1.0:1790947179.197170:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+7:18029:x1877943573953280:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 183us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947179.197177:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:1.0:1790947179.200236:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.200349:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953408 00000100:00100000:0.0:1790947179.200372:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953408 00000100:00100000:0.0:1790947179.200438:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1790947179.200450:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c76afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+7:18029:x1877943573953408:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790947179.200805:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c76afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+8:18029:x1877943573953408:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 352us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.200822:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:3.0:1790947179.204993:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947179.205122:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953536 00000100:00100000:2.0:1790947179.205135:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953536 00000100:00100000:2.0:1790947179.205197:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1790947179.205208:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+8:18029:x1877943573953536:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790947179.205416:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+8:18029:x1877943573953536:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 209us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947179.205425:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:3.0:1790947179.210267:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.210569:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953664 00000100:00100000:1.0:1790947179.210583:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953664 00000100:00100000:1.0:1790947179.210657:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:1.0:1790947179.210669:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+8:18047:x1877943573953664:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790947179.210915:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+8:18047:x1877943573953664:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 248us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947179.210925:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:1.0:1790947179.248445:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.249157:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953792 00000100:00100000:0.0:1790947179.249173:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953792 00000100:00100000:0.0:1790947179.249286:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:0.0:1790947179.249305:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+8:18047:x1877943573953792:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790947179.249801:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+8:18047:x1877943573953792:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 500us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.249996:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:3.0:1790947179.256703:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947179.256797:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573953920 00000100:00100000:2.0:1790947179.256813:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573953920 00000100:00100000:2.0:1790947179.256924:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:2.0:1790947179.256936:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+8:18047:x1877943573953920:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790947179.257304:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+8:18047:x1877943573953920:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 370us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947179.257315:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:3.0:1790947179.272267:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.278349:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954048 00000100:00100000:1.0:1790947179.278384:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954048 00000100:00100000:1.0:1790947179.278473:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1790947179.278674:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+8:18029:x1877943573954048:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790947179.278706:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947179.278729:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b0c7601a00/0xe6f6b79c2d6deff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f081 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.278765:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b0c7601a00/0xe6f6b79c2d6deff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f081 expref: 9 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.278778:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b0c7601a00/0xe6f6b79c2d6deff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f081 expref: 9 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.278788:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7601a00, rc 0) 00000100:00100000:1.0:1790947179.278910:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+9:18029:x1877943573954048:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 240us (6658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947179.284564:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.284651:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954176 00000100:00100000:0.0:1790947179.284665:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954176 00000100:00100000:1.0:1790947179.288493:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:0.0:1790947179.290626:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:0.0:1790947179.290656:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+9:18029:x1877943573954176:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790947179.290825:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790947179.290878:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790947179.290883:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790947179.290887:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790947179.290890:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790947179.290893:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1790947179.296112:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+9:18029:x1877943573954176:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 5336us (11426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.296137:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:3.0:1790947179.302181:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.302423:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954304 00000100:00100000:0.0:1790947179.302437:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954304 00000100:00100000:0.0:1790947179.302619:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:0.0:1790947179.302646:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f6c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+9:18029:x1877943573954304:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790947179.302669:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947179.302703:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f088 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947179.302740:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 10 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947179.302753:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 10 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947179.302764:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e25800, rc 0) 00000100:00100000:0.0:1790947179.302847:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f6c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+10:18029:x1877943573954304:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 202us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.302899:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:3.0:1790947179.306799:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.307039:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954432 00000100:00100000:0.0:1790947179.307053:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954432 00000100:00100000:0.0:1790947179.307135:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:0.0:1790947179.307147:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+10:18029:x1877943573954432:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790947179.307349:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+10:18029:x1877943573954432:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 203us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.308849:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:3.0:1790947179.311980:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.312760:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954560 00000100:00100000:0.0:1790947179.312776:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954560 00000100:00100000:0.0:1790947179.312885:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:0.0:1790947179.312899:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+10:18029:x1877943573954560:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790947179.313729:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+10:18029:x1877943573954560:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 828us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.313753:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:3.0:1790947179.318186:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.318385:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954688 00000100:00100000:0.0:1790947179.318400:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954688 00000100:00100000:0.0:1790947179.318473:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:0.0:1790947179.318493:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+10:18051:x1877943573954688:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790947179.318705:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+10:18051:x1877943573954688:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 214us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.318714:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1790947179.326833:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.327351:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954816 00000100:00100000:0.0:1790947179.327366:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954816 00000100:00100000:0.0:1790947179.327491:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:0.0:1790947179.327503:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+10:18051:x1877943573954816:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790947179.327694:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+10:18051:x1877943573954816:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 193us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.327704:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 131 00010000:00010000:2.0:1790947179.342333:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947179.345026:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.345147:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.345423:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573954944 00000100:00100000:0.0:1790947179.345434:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573954944 00000100:00100000:0.0:1790947179.345483:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955200 00000100:00100000:0.0:1790947179.345488:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955200 00000100:00100000:2.0:1790947179.345510:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1790947179.345543:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1877943573954944:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790947179.345592:0:22753:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 570e5cec-6181-4423-9892-8b4e68369024@192.168.203.29@tcp t0 exp 0000000000000000 cur 675 last 0 00000100:00100000:0.0:1790947179.345647:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1790947179.345658:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1877943573955200:12345-192.168.203.29@tcp:38:mount.lustre.0 00000020:00000080:2.0:1790947179.345664:0:22753:0:(genops.c:1384:class_connect()) connect: client 570e5cec-6181-4423-9892-8b4e68369024, cookie 0xe6f6b79c2d6df000 00010000:00080000:0.0:1790947179.345693:0:24232:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 570e5cec-6181-4423-9892-8b4e68369024@192.168.203.29@tcp t0 exp 0000000000000000 cur 675 last 0 00000004:00100000:2.0:1790947179.345709:0:22753:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:0.0:1790947179.345750:0:24232:0:(genops.c:1384:class_connect()) connect: client 570e5cec-6181-4423-9892-8b4e68369024, cookie 0xe6f6b79c2d6df007 00000004:00100000:0.0:1790947179.345777:0:24232:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790947179.346078:0:24232:0:(import.c:65:import_set_state_nolock()) ffff94b0c7c17000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790947179.346177:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+6:2401:x1877943573955200:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 518us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.346186:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00080000:2.0:1790947179.346192:0:22753:0:(import.c:65:import_set_state_nolock()) ffff94b0c1088000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947179.346255:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+6:2401:x1877943573954944:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 712us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947179.346265:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1790947179.353198:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947179.353243:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.353424:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955072 00000100:00100000:0.0:1790947179.353425:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955456 00000100:00100000:1.0:1790947179.353447:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955072 00000100:00100000:0.0:1790947179.353447:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955456 00000100:00100000:0.0:1790947179.353541:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1790947179.353553:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+7:18029:x1877943573955456:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790947179.353590:0:22752:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790947179.353675:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+7:18029:x1877943573955456:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 124us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.353683:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:3.0:1790947179.353903:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790947179.354242:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1790947179.354255:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+6:0:x1877943573955072:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790947179.354285:0:24232:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790947179.354365:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+6:0:x1877943573955072:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 114us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947179.354373:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1790947179.363913:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.364124:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955328 00000100:00100000:1.0:1790947179.364138:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955328 00000100:00100000:1.0:1790947179.364256:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00080000:3.0:1790947179.364258:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790947179.364270:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+6:0:x1877943573955328:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790947179.364338:0:22754:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790947179.364440:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+6:0:x1877943573955328:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 175us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947179.364448:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1790947179.364927:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.364974:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955584 00000100:00100000:0.0:1790947179.364981:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955584 00000100:00100000:0.0:1790947179.367270:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1790947179.367297:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+6:18029:x1877943573955584:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790947179.370583:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+6:18029:x1877943573955584:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 1021us (3376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.370604:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1790947179.382428:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.382479:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947179.382610:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.382674:0:22763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955968 00000100:00100000:1.0:1790947179.382699:0:22763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955968 00000100:00100000:1.0:1790947179.382776:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1790947179.382787:0:22763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:570e5cec-6181-4423-9892-8b4e68369024+6:18029:x1877943573955968:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790947179.382930:0:22763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:570e5cec-6181-4423-9892-8b4e68369024+6:18029:x1877943573955968:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 143us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947179.382939:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:3.0:1790947179.391293:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955712 00000100:00100000:3.0:1790947179.391316:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955712 00000100:00100000:2.0:1790947179.392809:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573955840 00000100:00100000:2.0:1790947179.392825:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573955840 00000100:00100000:2.0:1790947179.392917:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1790947179.392928:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1877943573955840:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790947179.392976:0:24261:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 570e5cec-6181-4423-9892-8b4e68369024@192.168.203.29@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1790947179.393392:0:24261:0:(genops.c:1384:class_connect()) connect: client 570e5cec-6181-4423-9892-8b4e68369024, cookie 0xe6f6b79c2d6df00e 00002000:00100000:2.0:1790947179.393415:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 570e5cec-6181-4423-9892-8b4e68369024/ffff94b1ed18d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790947179.393443:0:24261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790947179.393845:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790947179.393941:0:24261:0:(import.c:65:import_set_state_nolock()) ffff94b1c5564800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790947179.394158:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947179.394400:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+6:2401:x1877943573955840:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 1471us (11787us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947179.394411:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1790947179.394923:0:22755:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956096 00000100:00100000:2.0:1790947179.394932:0:22755:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956096 00000100:00100000:2.0:1790947179.394978:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1790947179.394989:0:22755:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+6:18029:x1877943573956096:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790947179.402413:0:22755:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4848us 00000100:00100000:0.0:1790947179.403588:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1790947179.403603:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1877943573955712:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790947179.403665:0:24260:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 570e5cec-6181-4423-9892-8b4e68369024@192.168.203.29@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:0.0:1790947179.404616:0:24260:0:(genops.c:1384:class_connect()) connect: client 570e5cec-6181-4423-9892-8b4e68369024, cookie 0xe6f6b79c2d6df015 00002000:00100000:0.0:1790947179.404635:0:24260:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 570e5cec-6181-4423-9892-8b4e68369024/ffff94b0c7c13000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790947179.404661:0:24260:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790947179.404987:0:24260:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790947179.405035:0:24260:0:(import.c:65:import_set_state_nolock()) ffff94b0c7c16000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790947179.406742:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:570e5cec-6181-4423-9892-8b4e68369024+6:2401:x1877943573955712:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 3126us (24246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947179.406758:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000004:00200000:2.0:1790947179.428547:0:22755:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790947179.428901:0:22755:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+6:18029:x1877943573956096:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 33905us (34735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947179.428915:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1790947179.648346:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947179.648786:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956224 00000100:00100000:1.0:1790947179.648799:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956224 00000100:00100000:1.0:1790947179.649118:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1790947179.649132:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+6:18074:x1877943573956224:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:1.0:1790947179.649161:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947179.649194:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df01c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f0b9 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.649290:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600a00/0xe6f6b79c2d6df023 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.649308:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600a00/0xe6f6b79c2d6df023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.649348:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600a00/0xe6f6b79c2d6df023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790947179.649430:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790947179.649435:0:22754:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790947179.649483:0:22754:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600a00/0xe6f6b79c2d6df023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.649513:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df01c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0b9 expref: 8 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.649538:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600a00/0xe6f6b79c2d6df023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0b9 expref: 7 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947179.649548:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:1.0:1790947179.649551:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790947179.649555:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600a00, rc 0) 00000100:00100000:1.0:1790947179.651109:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+7:18074:x1877943573956224:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 1960us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947179.651124:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1790947180.238343:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593995904:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238412:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.238475:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593996416:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238499:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.238517:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1877943593996928:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238542:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.238565:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1790947180.238571:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593995520:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.238622:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593996032:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.238657:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943593996544:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.238691:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1877943593997056:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.238709:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947180.238834:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593995776:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.238888:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947180.238919:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593996288:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.238943:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947180.238957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593996800:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.238999:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995904 00000100:00100000:3.0:1790947180.239007:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995904 00000100:00100000:3.0:1790947180.239148:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996416 00000100:00100000:3.0:1790947180.239152:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996416 00000100:00100000:3.0:1790947180.239168:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995776 00000100:00100000:3.0:1790947180.239170:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995776 00000100:00100000:3.0:1790947180.239181:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996288 00000100:00100000:3.0:1790947180.239184:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996288 00000100:00100000:3.0:1790947180.239196:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790947180.239204:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877943593995904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.239264:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877943593995904:12345-0@lo:400:kworker.0 Request processed in 60us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.239271:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790947180.239286:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790947180.239292:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593996416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.239316:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593996416:12345-0@lo:400:kworker.0 Request processed in 25us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.239322:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790947180.239331:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790947180.239337:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593995776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.239364:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943593995776:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.239370:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790947180.239379:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790947180.239392:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593996288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.239418:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593996288:12345-0@lo:400:kworker.0 Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.239422:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1790947180.239437:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790947180.239441:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790947180.239452:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995520 00000100:00100000:3.0:1790947180.239455:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995520 00000100:00100000:3.0:1790947180.239478:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790947180.239490:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943593995520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.239521:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943593995520:12345-0@lo:400:kworker.0 Request processed in 36us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.239527:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790947180.239591:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593995648:0@lo:400:kworker.0 00000100:00100000:1.0:1790947180.239632:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947180.239656:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593996160:0@lo:400:kworker.0 00000100:00100000:1.0:1790947180.239687:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947180.239715:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1877943593996672:0@lo:400:kworker.0 00000100:00100000:1.0:1790947180.239754:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947180.239891:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593995904:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.239948:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593996416:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.239981:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943593995520:0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.240068:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593995648 00000100:00100000:2.0:1790947180.240072:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593995648 00000100:00100000:2.0:1790947180.240110:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996160 00000100:00100000:2.0:1790947180.240114:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996160 00000100:00100000:2.0:1790947180.240128:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790947180.240135:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593995648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.240172:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593995648:12345-0@lo:400:kworker.0 Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947180.240177:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790947180.240192:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790947180.240197:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593996160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947180.240375:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593996160:12345-0@lo:400:kworker.0 Request processed in 177us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947180.240382:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790947180.241417:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593997184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790947180.241461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947180.241499:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593995648:0@lo:400:kworker.0 00000100:00100000:1.0:1790947180.241510:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593996160:0@lo:400:kworker.0 00000100:00100000:1.0:1790947180.241528:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790947180.241534:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593997312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790947180.241556:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947180.241614:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997184 00000100:00100000:1.0:1790947180.241619:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997184 00000100:00100000:1.0:1790947180.241647:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997312 00000100:00100000:1.0:1790947180.241650:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997312 00000100:00100000:1.0:1790947180.241663:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947180.241670:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877943593997184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790947180.241689:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790947180.241728:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877943593997184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947180.241735:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790947180.241749:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790947180.241768:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593997312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790947180.241778:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790947180.241802:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593997312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947180.241808:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790947180.244191:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996928 00000100:00100000:3.0:1790947180.244206:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996928 00000100:00100000:3.0:1790947180.244691:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996032 00000100:00100000:3.0:1790947180.246182:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996032 00000100:00080000:3.0:1790947180.247124:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790947180.247174:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996544 00000100:00100000:3.0:1790947180.247183:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996544 00000100:00100000:3.0:1790947180.247195:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997056 00000100:00100000:3.0:1790947180.247199:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997056 00000100:00100000:3.0:1790947180.247303:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996672 00000100:00100000:3.0:1790947180.247306:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996672 00000100:00100000:3.0:1790947180.247329:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790947180.247339:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877943593996928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.247431:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877943593996928:12345-0@lo:400:kworker.0 Request processed in 93us (8887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.247438:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790947180.247469:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790947180.247476:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593996032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.247508:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943593996032:12345-0@lo:400:kworker.0 Request processed in 33us (8865us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.247514:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790947180.247525:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790947180.247532:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877943593996544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.247561:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877943593996544:12345-0@lo:400:kworker.0 Request processed in 30us (8885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.247566:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790947180.247576:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790947180.247582:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877943593997056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.247609:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877943593997056:12345-0@lo:400:kworker.0 Request processed in 27us (8898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.247614:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790947180.247625:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790947180.247631:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c77e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877943593996672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.247657:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c77e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877943593996672:12345-0@lo:400:kworker.0 Request processed in 26us (7903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.247663:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1790947180.247678:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790947180.247681:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790947180.248969:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947180.249126:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943593995776:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593996288:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249184:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593996800 00000100:00100000:3.0:1790947180.249190:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593996800 00000100:00100000:3.0:1790947180.249522:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790947180.249531:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877943593996800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249597:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1877943593996800:12345-0@lo:400:kworker.0 Request processed in 66us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947180.249604:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1790947180.249624:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790947180.249644:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c8506680 x1877943593996800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947180.249654:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1877943593996800:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249689:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943593996032:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249701:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943593996544:0@lo:400:kworker.0 00010000:00080000:3.0:1790947180.249782:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c8507100 x1877943593997056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947180.249793:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1877943593997056:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249808:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1877943593996928:0@lo:400:kworker.0 00000100:00100000:3.0:1790947180.249883:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593997312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947180.249901:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593997184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790947180.249913:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1877943593996672:0@lo:400:kworker.0 00010000:00010000:0.0:1790947180.366424:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790947180.754664:0:25077:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 570e5cec-6181-4423-9892-8b4e68369024 00000001:00080000:3.0:1790947180.754680:0:25077:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1790947181.390035:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947181.630528:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947181.630613:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956352 00000100:00100000:3.0:1790947181.630623:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956352 00000100:00100000:3.0:1790947181.630702:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1790947181.630712:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+7:18126:x1877943573956352:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:3.0:1790947181.630750:0:22753:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790947181.630899:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+7:18126:x1877943573956352:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 188us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947181.630907:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00080000:0.0:1790947181.631014:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790947181.633139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.633285:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956480 00000100:00100000:0.0:1790947181.633294:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956480 00000100:00100000:0.0:1790947181.633377:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:0.0:1790947181.633387:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+6:18126:x1877943573956480:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:0.0:1790947181.633428:0:22752:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790947181.633538:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+6:18126:x1877943573956480:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 152us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.633545:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:3.0:1790947181.633699:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790947181.638507:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947181.644171:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956608 00000100:00100000:1.0:1790947181.644186:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956608 00000100:00100000:1.0:1790947181.644336:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1790947181.644373:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:570e5cec-6181-4423-9892-8b4e68369024+6:18126:x1877943573956608:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:1.0:1790947181.644404:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790947181.644502:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:570e5cec-6181-4423-9892-8b4e68369024+6:18126:x1877943573956608:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 132us (6003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947181.644509:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00080000:3.0:1790947181.646626:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790947181.647536:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.647646:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956736 00000100:00100000:2.0:1790947181.647655:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956736 00000100:00080000:3.0:1790947181.647985:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790947181.648049:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1790947181.648144:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:570e5cec-6181-4423-9892-8b4e68369024+5:18126:x1877943573956736:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:2.0:1790947181.648178:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790947181.648330:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:570e5cec-6181-4423-9892-8b4e68369024+5:18126:x1877943573956736:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 272us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.648338:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1790947181.848773:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947181.848961:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956864 00000100:00100000:3.0:1790947181.848971:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956864 00000100:00100000:3.0:1790947181.849029:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:3.0:1790947181.849038:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+10:18156:x1877943573956864:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790947181.849055:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947181.849072:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6df02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f0c0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947181.849114:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6df02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0c0 expref: 11 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947181.849137:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13ce600/0xe6f6b79c2d6df02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0c0 expref: 11 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947181.849146:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13ce600, rc 0) 00000100:00100000:3.0:1790947181.849211:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+11:18156:x1877943573956864:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 173us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947181.849231:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:0.0:1790947181.854618:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.854723:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573956992 00000100:00100000:2.0:1790947181.854733:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573956992 00000100:00100000:2.0:1790947181.854808:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:2.0:1790947181.854818:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+11:18156:x1877943573956992:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790947181.855029:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+11:18156:x1877943573956992:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 211us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.855037:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:1.0:1790947181.856753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.856894:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957120 00000100:00100000:0.0:1790947181.856903:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957120 00000100:00100000:0.0:1790947181.856956:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:0.0:1790947181.856979:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+11:18156:x1877943573957120:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790947181.857116:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+11:18156:x1877943573957120:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 139us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.857125:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:0.0:1790947181.860298:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947181.865003:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957248 00000100:00100000:3.0:1790947181.865020:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957248 00000100:00100000:3.0:1790947181.865097:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:3.0:1790947181.865108:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd24cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+11:18164:x1877943573957248:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790947181.865419:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd24cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+11:18164:x1877943573957248:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 311us (5128us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947181.865428:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:1.0:1790947181.899630:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.901445:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957376 00000100:00100000:2.0:1790947181.901458:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957376 00000100:00100000:2.0:1790947181.901583:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:2.0:1790947181.901595:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+11:18164:x1877943573957376:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790947181.901768:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+11:18164:x1877943573957376:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 175us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.901778:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:1.0:1790947181.914544:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.914638:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957504 00000100:00100000:0.0:1790947181.914649:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957504 00000100:00100000:0.0:1790947181.914698:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:0.0:1790947181.914708:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+11:18164:x1877943573957504:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790947181.914855:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+11:18164:x1877943573957504:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 148us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.914889:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:0.0:1790947181.924776:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.926378:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957632 00000100:00100000:2.0:1790947181.926397:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957632 00000100:00100000:2.0:1790947181.926488:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:2.0:1790947181.926501:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+11:18156:x1877943573957632:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790947181.926524:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947181.926547:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef222000/0xe6f6b79c2d6df031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f0f1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947181.926583:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef222000/0xe6f6b79c2d6df031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f1 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947181.926597:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef222000/0xe6f6b79c2d6df031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f1 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947181.926607:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222000, rc 0) 00000100:00100000:2.0:1790947181.926723:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+12:18156:x1877943573957632:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 223us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.926940:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:1.0:1790947181.936667:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947181.936790:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957760 00000100:00100000:3.0:1790947181.937090:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957760 00000100:00100000:3.0:1790947181.937170:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:3.0:1790947181.937183:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+12:18156:x1877943573957760:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790947181.937218:0:22747:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790947181.937264:0:22747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790947181.937270:0:22747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790947181.937274:0:22747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790947181.937277:0:22747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790947181.937280:0:22747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1790947181.940159:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+12:18156:x1877943573957760:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 2956us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947181.940178:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:0.0:1790947181.944431:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947181.945053:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573957888 00000100:00100000:3.0:1790947181.945067:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573957888 00000100:00100000:3.0:1790947181.945580:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:3.0:1790947181.945597:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+12:18156:x1877943573957888:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790947181.945641:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947181.945666:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f0f8 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947181.945713:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 13 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947181.945727:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 13 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947181.945751:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cea00, rc 0) 00000100:00100000:3.0:1790947181.945851:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+13:18156:x1877943573957888:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 257us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947181.945907:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1790947181.949073:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.949626:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958016 00000100:00100000:0.0:1790947181.949638:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958016 00000100:00100000:0.0:1790947181.949955:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:0.0:1790947181.949969:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:18156:x1877943573958016:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790947181.950403:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:18156:x1877943573958016:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 436us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.950412:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:1.0:1790947181.953436:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.953539:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958144 00000100:00100000:0.0:1790947181.953551:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958144 00000100:00100000:0.0:1790947181.953616:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:0.0:1790947181.953628:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:18156:x1877943573958144:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790947181.954632:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:18156:x1877943573958144:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 1001us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.954642:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:1.0:1790947181.960607:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.961319:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958272 00000100:00100000:2.0:1790947181.961336:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958272 00000100:00100000:2.0:1790947181.961420:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:2.0:1790947181.961432:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+13:18168:x1877943573958272:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790947181.961650:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+13:18168:x1877943573958272:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 220us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.961660:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:1.0:1790947181.965932:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.966071:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958400 00000100:00100000:0.0:1790947181.966097:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958400 00000100:00100000:0.0:1790947181.970887:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:0.0:1790947181.970919:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:18168:x1877943573958400:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790947181.971398:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:18168:x1877943573958400:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 494us (5477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.971409:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:1.0:1790947181.979001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.979283:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958528 00000100:00100000:2.0:1790947181.979297:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958528 00000100:00100000:2.0:1790947181.979361:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1790947181.979372:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1877943573958528:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790947181.979413:0:24232:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1d5d97ab-7494-4872-819e-977ae754088f@192.168.203.29@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1790947181.979460:0:24232:0:(genops.c:1384:class_connect()) connect: client 1d5d97ab-7494-4872-819e-977ae754088f, cookie 0xe6f6b79c2d6df03f 00000004:00100000:2.0:1790947181.979493:0:24232:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790947181.979640:0:24232:0:(import.c:65:import_set_state_nolock()) ffff94b1ff7e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947181.979746:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:2401:x1877943573958528:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 375us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.979756:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1790947181.982623:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.982946:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958784 00000100:00100000:2.0:1790947181.982959:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958784 00000100:00100000:2.0:1790947181.983073:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1790947181.983097:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1877943573958784:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790947181.983140:0:22754:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1d5d97ab-7494-4872-819e-977ae754088f@192.168.203.29@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1790947181.983209:0:22754:0:(genops.c:1384:class_connect()) connect: client 1d5d97ab-7494-4872-819e-977ae754088f, cookie 0xe6f6b79c2d6df046 00000004:00100000:2.0:1790947181.984585:0:22754:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790947181.984773:0:22754:0:(import.c:65:import_set_state_nolock()) ffff94b1ff7e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790947181.984909:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d5d97ab-7494-4872-819e-977ae754088f+6:2401:x1877943573958784:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 1810us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.984921:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1790947181.990092:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.990354:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958656 00000100:00100000:2.0:1790947181.990368:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958656 00000100:00100000:2.0:1790947181.990470:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1790947181.990482:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:0:x1877943573958656:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790947181.990535:0:24232:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790947181.990629:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:0:x1877943573958656:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 148us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947181.990638:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00080000:3.0:1790947181.991268:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790947181.994334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947181.994451:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959040 00000100:00100000:0.0:1790947181.994464:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959040 00000100:00100000:0.0:1790947181.994544:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1790947181.994556:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959040:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790947181.994599:0:22752:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790947181.994705:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959040:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 151us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947181.994713:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1790947181.998610:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947181.998786:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959168 00000100:00100000:2.0:1790947181.998800:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959168 00000100:00100000:2.0:1790947181.999921:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1790947181.999934:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959168:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790947182.000059:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959168:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 128us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947182.000066:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1790947182.004543:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947182.004673:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573958912 00000100:00100000:0.0:1790947182.004687:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573958912 00000100:00100000:0.0:1790947182.005047:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1790947182.005061:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:0:x1877943573958912:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790947182.005127:0:22752:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790947182.005214:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:0:x1877943573958912:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 156us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947182.005244:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00080000:3.0:1790947182.006538:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790947182.007590:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947182.007625:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947182.007656:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947182.007746:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959296 00000100:00100000:3.0:1790947182.007758:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959296 00000100:00100000:3.0:1790947182.007816:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959424 00000100:00100000:3.0:1790947182.007819:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959424 00000100:00100000:3.0:1790947182.007840:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1790947182.007849:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1877943573959296:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790947182.007914:0:24261:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1d5d97ab-7494-4872-819e-977ae754088f@192.168.203.29@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1790947182.007947:0:24261:0:(genops.c:1384:class_connect()) connect: client 1d5d97ab-7494-4872-819e-977ae754088f, cookie 0xe6f6b79c2d6df04d 00002000:00100000:3.0:1790947182.007961:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1d5d97ab-7494-4872-819e-977ae754088f/ffff94b0c5ae6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790947182.007975:0:24261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790947182.008057:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790947182.008122:0:24261:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ae1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790947182.008206:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d5d97ab-7494-4872-819e-977ae754088f+6:2401:x1877943573959296:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 356us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947182.008215:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1790947182.008237:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1790947182.008242:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1877943573959424:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790947182.008260:0:24261:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1d5d97ab-7494-4872-819e-977ae754088f@192.168.203.29@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1790947182.008276:0:24261:0:(genops.c:1384:class_connect()) connect: client 1d5d97ab-7494-4872-819e-977ae754088f, cookie 0xe6f6b79c2d6df054 00002000:00100000:3.0:1790947182.008281:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1d5d97ab-7494-4872-819e-977ae754088f/ffff94b0c5ae6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790947182.008288:0:24261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790947182.008337:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790947182.008353:0:24261:0:(import.c:65:import_set_state_nolock()) ffff94b0c5ae2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790947182.008377:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d5d97ab-7494-4872-819e-977ae754088f+6:2401:x1877943573959424:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 134us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947182.008383:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1790947182.009122:0:22763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959552 00000100:00100000:3.0:1790947182.009131:0:22763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959552 00000100:00100000:3.0:1790947182.009187:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1790947182.009196:0:22763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959552:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790947182.009260:0:22763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959552:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 64us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947182.009267:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1790947182.024532:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947182.024839:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959680 00000100:00100000:0.0:1790947182.024854:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959680 00000100:00100000:0.0:1790947182.024974:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1790947182.024987:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959680:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790947182.025123:0:22756:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790947182.025225:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d5d97ab-7494-4872-819e-977ae754088f+6:18156:x1877943573959680:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 240us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947182.025235:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1790947182.157847:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947182.158477:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959808 00000100:00100000:2.0:1790947182.158491:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959808 00000100:00100000:2.0:1790947182.158570:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1790947182.158582:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:18192:x1877943573959808:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:2.0:1790947182.158631:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947182.159207:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df05b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f129 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947182.159385:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947182.159405:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947182.159422:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790947182.159481:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790947182.159486:0:24232:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790947182.159513:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947182.159547:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df05b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947182.159569:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 7 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947182.159581:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:2.0:1790947182.159584:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790947182.159588:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222800, rc 0) 00000100:00100000:2.0:1790947182.160003:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+7:18192:x1877943573959808:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 1422us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947182.160013:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1790947182.287826:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593997440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790947182.288048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947182.288632:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997440 00000100:00100000:0.0:1790947182.288643:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997440 00000100:00100000:0.0:1790947182.288731:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790947182.288746:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593997440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790947182.288779:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790947182.288853:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943593997440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947182.288885:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790947182.288994:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790947182.289098:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943593997440:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790947182.418464:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947183.309980:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790947183.310002:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593997568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790947183.310086:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947183.310142:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997568 00000100:00100000:2.0:1790947183.310150:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997568 00000100:00100000:2.0:1790947183.310206:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790947183.310214:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593997568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790947183.310248:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790947183.310294:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593997568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947183.310302:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790947183.310348:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593997568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947183.310570:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593997696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947183.310608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947183.310649:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997696 00000100:00100000:3.0:1790947183.310653:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997696 00000100:00100000:3.0:1790947183.310707:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947183.310715:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593997696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790947183.310735:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947183.310770:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593997696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947183.310776:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947183.310821:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593997696:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790947183.311547:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790947183.312618:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593997824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790947183.312676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947183.312726:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997824 00000100:00100000:3.0:1790947183.312734:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997824 00000100:00100000:3.0:1790947183.312773:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790947183.312781:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593997824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790947183.312812:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790947183.312871:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593997824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947183.312878:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790947183.312921:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593997824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790947183.444426:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790947184.463051:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790947184.782443:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1790947184.848995:0:23485:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1d5d97ab-7494-4872-819e-977ae754088f 00000001:00100000:3.0:1790947184.849008:0:23485:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 570e5cec-6181-4423-9892-8b4e68369024 00000001:00100000:2.0:1790947184.856671:0:24255:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d5d97ab-7494-4872-819e-977ae754088f 00000001:00100000:2.0:1790947184.856681:0:24255:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 570e5cec-6181-4423-9892-8b4e68369024 00000001:00100000:1.0:1790947184.857340:0:22732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d5d97ab-7494-4872-819e-977ae754088f 00000001:00100000:1.0:1790947184.857347:0:22732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 570e5cec-6181-4423-9892-8b4e68369024 00000001:02000400:0.0:1790947184.888015:0:25636:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1790947185.358581:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593998208:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.358647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947185.358721:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593998720:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.358747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947185.358765:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1877943593999232:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.358789:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947185.358812:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790947185.358817:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593998336:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.358878:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947185.358905:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593998848:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.358925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947185.358939:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1877943593999360:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.358958:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947185.358990:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998208 00000100:00100000:3.0:1790947185.358998:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998208 00000100:00100000:3.0:1790947185.359042:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998720 00000100:00100000:3.0:1790947185.359045:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998720 00000100:00100000:3.0:1790947185.359076:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998336 00000100:00100000:3.0:1790947185.359078:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998336 00000100:00100000:3.0:1790947185.359090:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998848 00000100:00100000:3.0:1790947185.359093:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998848 00000100:00100000:3.0:1790947185.359107:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790947185.359114:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593998208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359165:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593998208:12345-0@lo:400:kworker.0 Request processed in 50us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.359172:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790947185.359173:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593998080:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359198:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790947185.359204:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593998720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359227:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593998592:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359277:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1877943593999104:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359327:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790947185.359334:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3640:1877943593997952:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359360:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359379:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593998464:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359412:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877943593998976:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359439:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593999488:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.359454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947185.359475:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999232 00000100:00100000:0.0:1790947185.359478:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999232 00000100:00100000:0.0:1790947185.359660:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999360 00000100:00100000:0.0:1790947185.359664:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999360 00000100:00100000:0.0:1790947185.359676:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999104 00000100:00100000:0.0:1790947185.359678:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999104 00000100:00100000:0.0:1790947185.359689:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998464 00000100:00100000:0.0:1790947185.359691:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998464 00000100:00100000:0.0:1790947185.359700:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998976 00000100:00100000:0.0:1790947185.359702:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998976 00000100:00100000:3.0:1790947185.359710:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593998720:12345-0@lo:400:kworker.0 Request processed in 506us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947185.359712:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999488 00000100:00100000:0.0:1790947185.359714:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999488 00000100:00100000:3.0:1790947185.359722:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790947185.359726:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790947185.359731:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877943593999232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359733:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790947185.359738:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593998336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359761:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943593998336:12345-0@lo:400:kworker.0 Request processed in 22us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947185.359761:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877943593999232:12345-0@lo:400:kworker.0 Request processed in 29us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.359766:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790947185.359767:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790947185.359776:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947185.359782:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593998848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359807:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943593998848:12345-0@lo:400:kworker.0 Request processed in 26us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.359813:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790947185.359924:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1790947185.359941:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c70bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593998336:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359953:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593998848:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359961:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943593998208:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.359969:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943593998720:0@lo:400:kworker.0 00010000:00080000:3.0:1790947185.359980:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1fd0f2680 x1877943593999232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947185.359989:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1877943593999232:0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.360033:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998080 00000100:00100000:3.0:1790947185.360037:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998080 00000100:00100000:0.0:1790947185.360066:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790947185.360073:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877943593999360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.360110:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877943593999360:12345-0@lo:400:kworker.0 Request processed in 37us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.360114:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593998592 00000100:00100000:0.0:1790947185.360116:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790947185.360117:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593998592 00000100:00100000:0.0:1790947185.360126:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790947185.360131:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877943593999104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.360137:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790947185.360142:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593998080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.360396:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943593998080:12345-0@lo:400:kworker.0 Request processed in 34us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947185.360396:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877943593999104:12345-0@lo:400:kworker.0 Request processed in 264us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.360403:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790947185.360404:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790947185.360417:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790947185.360417:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790947185.360423:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593998592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.360424:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593998464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.360450:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943593998592:12345-0@lo:400:kworker.0 Request processed in 28us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947185.360450:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877943593998464:12345-0@lo:400:kworker.0 Request processed in 27us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.360457:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790947185.360457:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790947185.360468:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790947185.360474:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877943593998976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.360494:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790947185.360501:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877943593999488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947185.360531:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877943593999488:12345-0@lo:400:kworker.0 Request processed in 31us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947185.360537:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790947185.360577:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877943593998976:12345-0@lo:400:kworker.0 Request processed in 103us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947185.360582:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790947185.360610:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877943593998464:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.360620:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877943593998976:0@lo:400:kworker.0 00010000:00080000:0.0:1790947185.360629:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1fd0f0e00 x1877943593999488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947185.360696:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1877943593999360:0@lo:400:kworker.0 00000100:00100000:2.0:1790947185.360938:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790947185.360950:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593999616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790947185.360981:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790947185.361011:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790947185.361015:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790947185.361018:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790947185.361020:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947185.361032:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593997952 00000100:00100000:2.0:1790947185.361041:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593997952 00000100:00100000:1.0:1790947185.361174:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790947185.361189:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593999744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790947185.361217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947185.361244:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999616 00000100:00100000:1.0:1790947185.361248:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999616 00000100:00100000:1.0:1790947185.361266:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999744 00000100:00100000:1.0:1790947185.361268:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999744 00000100:00100000:1.0:1790947185.361280:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790947185.361286:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593999616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790947185.361653:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790947185.361694:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943593999616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 407us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947185.361700:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790947185.361715:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790947185.361722:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593999744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790947185.361731:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790947185.361747:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790947185.361754:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3640:x1877943593997952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790947185.361787:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3640:x1877943593997952:12345-0@lo:400:kworker.0 Request processed in 34us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947185.361793:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790947185.361883:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943593999616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790947185.361945:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1877943593999488:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.361961:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943593998080:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.361972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943593998592:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.361982:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1877943593999104:0@lo:400:kworker.0 00000100:00100000:0.0:1790947185.362004:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3640:1877943593997952:0@lo:400:kworker.0 00000100:00100000:1.0:1790947185.362082:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593999744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 360us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947185.362088:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790947185.362114:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593999744:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790947185.487788:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947186.512996:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790947187.139939:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947187.139977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947187.140007:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947187.140031:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947187.140041:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573959936 00000100:00100000:2.0:1790947187.140060:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573959936 00000100:00100000:1.0:1790947187.140070:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947187.140096:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947187.140114:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:1.0:1790947187.140121:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947187.140126:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+13:2404:x1877943573959936:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.140159:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947187.140195:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947187.140215:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960192 00000100:00100000:1.0:1790947187.140219:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960192 00000100:00100000:1.0:1790947187.140253:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960704 00000100:00100000:1.0:1790947187.140256:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960704 00000100:00100000:1.0:1790947187.140266:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960064 00000100:00100000:1.0:1790947187.140269:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960064 00000100:00100000:1.0:1790947187.140279:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960576 00000100:00100000:1.0:1790947187.140281:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960576 00000100:00100000:1.0:1790947187.140294:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1790947187.140301:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573960192:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.140351:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573960192:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 50us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.140359:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1790947187.140389:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:1.0:1790947187.140397:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+5:2404:x1877943573960704:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1790947187.143997:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960448 00000100:00100000:0.0:1790947187.144013:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960448 00000100:00100000:0.0:1790947187.144072:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960960 00000100:00100000:0.0:1790947187.144075:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960960 00000100:00100000:0.0:1790947187.144091:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960320 00000100:00100000:0.0:1790947187.144094:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960320 00000100:00100000:0.0:1790947187.144106:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573960832 00000100:00100000:0.0:1790947187.144109:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573960832 00000100:00100000:0.0:1790947187.144130:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1790947187.144140:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573960448:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947187.145569:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+13:2404:x1877943573959936:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 5436us (5629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947187.145585:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:1.0:1790947187.145606:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1790947187.145622:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+6:2404:x1877943573960064:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.145680:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+6:2404:x1877943573960064:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 65us (5584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.145688:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1790947187.145708:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1790947187.145715:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:2404:x1877943573960576:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.145737:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:2404:x1877943573960576:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (5580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.145751:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1790947187.145772:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1790947187.145779:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:2404:x1877943573960960:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.145801:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:2404:x1877943573960960:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.145806:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1790947187.145818:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1790947187.145824:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573960320:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.145845:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573960320:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.145851:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1790947187.145883:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1790947187.145891:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d5d97ab-7494-4872-819e-977ae754088f+5:2404:x1877943573960832:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1790947187.145914:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d5d97ab-7494-4872-819e-977ae754088f+5:2404:x1877943573960832:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.145920:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00080000:1.0:1790947187.145939:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790947187.145945:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790947187.145948:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790947187.145952:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790947187.146255:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+5:2404:x1877943573960704:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 5858us (6222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947187.146263:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1790947187.151523:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573960448:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 7372us (11502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947187.151539:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1790947187.406552:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593999872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790947187.406632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947187.409925:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943593999872 00000100:00100000:0.0:1790947187.409939:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943593999872 00000100:00100000:0.0:1790947187.410003:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790947187.410012:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593999872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790947187.410067:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1790947187.410251:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790947187.411250:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943593999872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1234us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947187.411262:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790947187.411405:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943593999872:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790947187.538760:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790947187.919537:0:25077:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d5d97ab-7494-4872-819e-977ae754088f 00000020:00000080:0.0:1790947188.179475:0:25784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9fb4f180 20000000:00000080:0.0:1790947188.179491:0:25784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94b1c5e88400 uarg=0000000000000000 20000000:01000000:0.0:1790947188.179535:0:25784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790947188.179541:0:25784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790947188.179545:0:25784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790947188.183430:0:25785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1790947188.183931:0:25784:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790947188.192193:0:25784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790947188.192222:0:25784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192240:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192248:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192255:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192262:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192271:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 12 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192278:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192299:0:25784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192337:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192351:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 12 pid: 22746 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.192366:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7cd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000000:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947188.192443:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 12 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192452:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 12 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.192459:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7cd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000128:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947188.192480:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.192488:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 23 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.192495:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7cd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000256:0@lo:104: 00000100:00100000:0.0:1790947188.192529:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790947188.195900:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.195943:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 23 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.195959:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7cd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000384:0@lo:104: 00000100:00100000:0.0:1790947188.196010:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790947188.196654:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.196664:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 23 pid: 22744 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.196674:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7cd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000512:0@lo:104: 00000100:00100000:0.0:1790947188.196703:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947188.202877:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594000256 00000100:00100000:3.0:1790947188.202893:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594000256 00000100:00100000:3.0:1790947188.203202:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594000384 00000100:00100000:3.0:1790947188.203207:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594000384 00000100:00100000:3.0:1790947188.203224:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790947188.203234:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:25784:x1877943594000256:12345-0@lo:104: 00010000:00010000:3.0:1790947188.203252:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.203393:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790947188.203400:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:25784:x1877943594000256:12345-0@lo:104: Request processed in 168us (10871us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.203408:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790947188.203431:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790947188.203438:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:25784:x1877943594000384:12345-0@lo:104: 00010000:00010000:3.0:1790947188.203826:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.205060:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 23 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.205078:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 23 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.205092:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000640:0@lo:104: 00000100:00100000:0.0:1790947188.205138:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947188.205150:0:25784:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c56dc180 going to sleep for 11 seconds 00000100:00100000:0.0:1790947188.205172:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7cd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000256:0@lo:104: 00000100:00100000:0.0:1790947188.205181:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7cd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000384:0@lo:104: 00010000:00010000:2.0:1790947188.206908:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790947188.207031:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207052:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600c00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:2.0:1790947188.207056:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207067:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790947188.207074:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947188.207095:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790947188.207191:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207198:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790947188.207224:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207232:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b0c7600c00/0xe6f6b79c2d6dee86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6dee8d expref: -99 pid: 25076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207244:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790947188.207247:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207252:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13ce800 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:2.0:1790947188.207255:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207261:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790947188.207267:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790947188.207272:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790947188.207286:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207292:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790947188.207306:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207312:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c13ce800/0xe6f6b79c2d6ded0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6ded13 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207323:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947188.207324:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790947188.207327:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947188.207349:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594000768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790947188.207409:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947188.207465:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790947188.207471:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594000896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790947188.207493:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947188.207530:0:24286:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594000768 00000100:00100000:2.0:1790947188.207537:0:24286:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594000768 00010000:00010000:2.0:1790947188.207564:0:24286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 24 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947188.207586:0:24286:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594000896 00000100:00100000:2.0:1790947188.207589:0:24286:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594000896 00010000:00010000:2.0:1790947188.207599:0:24286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 25 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947188.207616:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790947188.207623:0:24286:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+25:3639:x1877943594000768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790947188.207635:0:24286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947188.207640:0:24286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 25 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207660:0:24286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 25 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207674:0:24286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c29a00/0xe6f6b79c2d6dee8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6dee86 expref: 25 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207687:0:24286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947188.207721:0:24286:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943594000768:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947188.207728:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790947188.207746:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790947188.207758:0:24286:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:3639:x1877943594000896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790947188.207765:0:24286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947188.207769:0:24286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 23 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207777:0:24286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 23 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207787:0:24286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1f6c28e00/0xe6f6b79c2d6ded13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6ded0c expref: 23 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.207795:0:24286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947188.207817:0:24286:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:3639:x1877943594000896:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947188.207823:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790947188.207886:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594000896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790947188.207897:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594000768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790947188.209233:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1790947188.209251:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:25784:x1877943594000384:12345-0@lo:104: Request processed in 5809us (13237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.209262:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790947188.209287:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594000512 00000100:00100000:3.0:1790947188.209293:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594000512 00000100:00100000:3.0:1790947188.209317:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594000640 00000100:00100000:3.0:1790947188.209321:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594000640 00000100:00100000:3.0:1790947188.209333:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790947188.209341:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:25784:x1877943594000512:12345-0@lo:104: 00010000:00010000:3.0:1790947188.209353:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209424:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790947188.209430:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+4:25784:x1877943594000512:12345-0@lo:104: Request processed in 91us (12728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.209436:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790947188.209447:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790947188.209466:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:25784:x1877943594000640:12345-0@lo:104: 00010000:00010000:3.0:1790947188.209474:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209509:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790947188.209514:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+3:25784:x1877943594000640:12345-0@lo:104: Request processed in 51us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.209520:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790947188.209550:0:25346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790947188.209555:0:25346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209562:0:25346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c646be00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947188.209566:0:25346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209575:0:25346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947188.209582:0:25346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947188.209589:0:25346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790947188.209622:0:25346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209628:0:25346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790947188.209648:0:25346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209666:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1c646be00/0xe6f6b79c2d6deccd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decd4 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209677:0:25346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790947188.209680:0:25346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209686:0:25346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29e00 already unused, calling callback (ffffffffc13f7c20) 10000000:00010000:3.0:1790947188.209689:0:25346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209696:0:25346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790947188.209702:0:25346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790947188.209706:0:25346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790947188.209720:0:25346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209726:0:25346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790947188.209733:0:25346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209739:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6decbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6f6b79c2d6decc6 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.209753:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947188.209761:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947188.209763:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790947188.209770:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947188.209784:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943594001024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790947188.209822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947188.209890:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947188.209897:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943594001152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947188.210090:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947188.210135:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7cd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000512:0@lo:104: 00000100:00100000:0.0:1790947188.210146:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000640:0@lo:104: 00000100:00100000:1.0:1790947188.210251:0:22738:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001024 00000100:00100000:1.0:1790947188.210256:0:22738:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001024 00010000:00010000:1.0:1790947188.210278:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 22 pid: 22744 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947188.210311:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790947188.210319:0:22738:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:3641:x1877943594001024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790947188.210330:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947188.210335:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 22 pid: 22744 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947188.210344:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 22 pid: 22744 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947188.210358:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef222600/0xe6f6b79c2d6decd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6deccd expref: 22 pid: 22744 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947188.210371:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947188.211650:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947188.211737:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947188.211763:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961088 00000100:00100000:2.0:1790947188.211769:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961088 00010000:00010000:2.0:1790947188.211796:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 13 pid: 22746 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947188.211814:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961216 00000100:00100000:2.0:1790947188.211817:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961216 00010000:00010000:2.0:1790947188.211827:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 14 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947188.211841:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1790947188.211849:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bce661d0-1e50-4766-a156-91ae28874164+14:2405:x1877943573961088:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947188.211876:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947188.211881:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 14 pid: 22746 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.211893:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 14 pid: 22746 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.211908:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947188.212149:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bce661d0-1e50-4766-a156-91ae28874164+14:2405:x1877943573961088:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 299us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947188.212156:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1790947188.212174:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1790947188.212180:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bce661d0-1e50-4766-a156-91ae28874164+13:2405:x1877943573961216:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947188.212188:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947188.212204:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 13 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.212214:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 13 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947188.212223:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947188.212244:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bce661d0-1e50-4766-a156-91ae28874164+13:2405:x1877943573961216:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 64us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947188.212250:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1790947188.212433:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947188.212490:0:24286:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001152 00000100:00100000:3.0:1790947188.212495:0:24286:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001152 00010000:00010000:3.0:1790947188.212512:0:24286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 22 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947188.212533:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947188.212540:0:24286:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1d0681850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:3641:x1877943594001152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790947188.212548:0:24286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947188.212551:0:24286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 22 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212559:0:24286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 22 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212570:0:24286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6decc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6f6b79c2d6decbf expref: 22 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212584:0:24286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212592:0:24286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212621:0:24286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212628:0:24286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212635:0:24286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212642:0:24286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212648:0:24286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24c00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:3.0:1790947188.212653:0:24286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212661:0:24286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212671:0:24286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947188.212680:0:24286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947188.212715:0:24286:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1d0681850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:3641:x1877943594001152:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.212722:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790947188.212826:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943594001152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790947188.213274:0:22738:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:3641:x1877943594001024:12345-0@lo:103:ldlm_bl.0 Request processed in 2954us (3450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947188.213282:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790947188.213337:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3641:1877943594001024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790947188.213567:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b1c13cea00/0xe6f6b79c2d6df038 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0f8 expref: 12 pid: 22746 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.213580:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7cd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000000:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947188.213615:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7e25800/0xe6f6b79c2d6deff9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f088 expref: 11 pid: 22747 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947188.213625:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7cd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1877943594000128:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947188.213653:0:25784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.213663:0:25784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.213669:0:25784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947188.213675:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94b0c7e24c00/0xe6f6b79c2d6df069 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947188.430046:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943594001280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947188.430111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947188.430170:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001280 00000100:00100000:3.0:1790947188.430178:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001280 00000100:00100000:3.0:1790947188.430229:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790947188.430239:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943594001280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790947188.430259:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947188.430309:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943594001280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.430316:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790947188.430337:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790947188.430383:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943594001280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947188.431323:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790947188.431336:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943594001536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947188.431378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947188.431416:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001536 00000100:00100000:3.0:1790947188.431421:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001536 00000100:00100000:3.0:1790947188.431454:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790947188.431462:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943594001536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790947188.431493:0:23493:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790947188.431533:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943594001536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947188.431539:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790947188.431563:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943594001408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790947188.431587:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947188.431641:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943594001536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790947188.431768:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001408 00000100:00100000:2.0:1790947188.431772:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001408 00000100:00100000:2.0:1790947188.431804:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790947188.431811:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943594001408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790947188.431829:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790947188.431890:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943594001408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947188.431896:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790947188.431936:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943594001408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790947188.558207:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790947189.391209:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790947189.567901:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.568171:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961344 00000100:00100000:3.0:1790947189.568181:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961344 00000100:00100000:3.0:1790947189.568269:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1790947189.568280:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+6:18661:x1877943573961344:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790947189.568464:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.568491:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29400/0xe6f6b79c2d6df070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f130 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568559:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568574:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568586:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568601:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568607:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568626:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568707:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28e00/0xe6f6b79c2d6df085 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568716:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28e00/0xe6f6b79c2d6df085 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568724:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28e00/0xe6f6b79c2d6df085 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947189.568765:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790947189.568768:0:24232:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790947189.568805:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28e00/0xe6f6b79c2d6df085 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568816:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568823:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568829:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568835:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.568839:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568845:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568882:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:3.0:1790947189.568885:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.568890:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568897:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.568913:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790947189.569770:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790947189.569822:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.569828:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.569832:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.569836:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.569843:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.569853:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94b0c6680d00) 00010000:00010000:3.0:1790947189.569856:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.569899:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.569906:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df07e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.579701:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29400/0xe6f6b79c2d6df070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f130 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.579733:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c28e00/0xe6f6b79c2d6df085 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f130 expref: 7 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.579742:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94b0c6680a00) 00010000:00010000:3.0:1790947189.579745:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790947189.579765:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c28e00, rc 0) 00000100:00100000:3.0:1790947189.579838:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+7:18661:x1877943573961344:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 11560us (11978us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.579848:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00010000:00010000:3.0:1790947189.581962:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947189.589932:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.590097:0:22764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961472 00000100:00100000:0.0:1790947189.590107:0:22764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961472 00000100:00100000:0.0:1790947189.590163:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1790947189.590174:0:22764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:570e5cec-6181-4423-9892-8b4e68369024+7:18661:x1877943573961472:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790947189.590266:0:22764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:570e5cec-6181-4423-9892-8b4e68369024+7:18661:x1877943573961472:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.590274:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1790947189.599491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.599588:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961728 00000100:00100000:1.0:1790947189.599599:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961728 00000100:00100000:1.0:1790947189.599668:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1790947189.599690:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+7:18661:x1877943573961728:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790947189.599713:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947189.599733:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df08c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f137 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.599816:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.599830:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.599839:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.599890:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.599898:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.599905:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.600418:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600200/0xe6f6b79c2d6df0a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.600429:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600200/0xe6f6b79c2d6df0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.600436:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600200/0xe6f6b79c2d6df0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790947189.600457:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1790947189.601443:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601456:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601464:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601469:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1790947189.601473:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601480:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601492:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94b0c6680a00) 00010000:00010000:1.0:1790947189.601495:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790947189.601499:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601505:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df093 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601520:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601525:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601544:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601549:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1790947189.601552:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601560:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601569:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94b1f4128d00) 00010000:00010000:1.0:1790947189.601571:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790947189.601574:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.601579:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df09a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.606597:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df08c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f137 expref: 10 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.606634:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600200/0xe6f6b79c2d6df0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f137 expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.606643:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94b1f4128300) 00010000:00010000:1.0:1790947189.606647:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790947189.606650:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600200, rc 0) 00000100:00100000:1.0:1790947189.606723:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+9:18661:x1877943573961728:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 7034us (7241us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1790947189.612686:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1790947189.617286:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.617526:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961856 00000100:00100000:3.0:1790947189.617537:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961856 00000100:00100000:3.0:1790947189.617596:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1790947189.617608:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+9:18661:x1877943573961856:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790947189.617756:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+9:18661:x1877943573961856:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 110us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.617813:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1790947189.622825:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.623205:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573961984 00000100:00100000:0.0:1790947189.623217:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573961984 00000100:00100000:0.0:1790947189.623297:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1790947189.623308:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+5:18661:x1877943573961984:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1790947189.623968:0:22752:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 620us 00000100:00080000:1.0:1790947189.631350:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790947189.635958:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.636159:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573962112 00000100:00100000:3.0:1790947189.636169:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573962112 00000100:00100000:3.0:1790947189.636222:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:3.0:1790947189.636232:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+9:18667:x1877943573962112:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1790947189.636252:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.636272:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29400/0xe6f6b79c2d6df0af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f13e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636335:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636350:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636378:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636432:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636441:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636447:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636487:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636495:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636501:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636506:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.636510:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636517:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636528:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:3.0:1790947189.636532:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.636536:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636549:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636563:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636570:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636576:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636581:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.636584:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636590:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636597:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94b0c6680d00) 00010000:00010000:3.0:1790947189.636600:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.636602:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636608:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636641:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29400/0xe6f6b79c2d6df0af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f13e expref: 10 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636661:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:3.0:1790947189.636663:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.636667:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29400/0xe6f6b79c2d6df0af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f13e expref: 10 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.636676:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c29400, rc 0) 00000100:00100000:3.0:1790947189.636738:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+9:18667:x1877943573962112:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 507us (790us total) trans 0 rc 301/301 00000100:00100000:3.0:1790947189.636812:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:3.0:1790947189.645367:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.645460:0:22761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573962240 00000100:00100000:1.0:1790947189.645470:0:22761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573962240 00000100:00100000:1.0:1790947189.645523:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1790947189.645534:0:22761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:570e5cec-6181-4423-9892-8b4e68369024+9:18667:x1877943573962240:12345-192.168.203.29@tcp:700:lfs.0 00000100:00100000:1.0:1790947189.645622:0:22761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:570e5cec-6181-4423-9892-8b4e68369024+9:18667:x1877943573962240:12345-192.168.203.29@tcp:700:lfs.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.645629:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1790947189.650393:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.650514:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573962496 00000100:00100000:2.0:1790947189.650525:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573962496 00000100:00100000:2.0:1790947189.650600:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:2.0:1790947189.650632:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+9:18667:x1877943573962496:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:2.0:1790947189.650714:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947189.650748:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600a00/0xe6f6b79c2d6df023 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f0b9 expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.650802:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:2.0:1790947189.650818:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790947189.651139:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.651155:0:22754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 5 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.651164:0:22754:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.651197:0:22754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 5 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.651212:0:22754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 5 pid: 24232 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947189.651224:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1877943594001664:192.168.203.29@tcp:104: 00000100:00100000:2.0:1790947189.651307:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41840 going to sleep for 11 seconds 00000100:00100000:3.0:1790947189.660089:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1877943594001664:192.168.203.29@tcp:104: 00010000:00010000:3.0:1790947189.660140:0:22754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947189.661520:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+5:18661:x1877943573961984:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 38203us (38695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.661535:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1790947189.661843:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.662666:0:24286:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573962624 00000100:00100000:2.0:1790947189.662679:0:24286:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573962624 00010000:00010000:2.0:1790947189.662739:0:24286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 6 pid: 24232 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947189.662797:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1790947189.662807:0:24286:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:2404:x1877943573962624:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947189.662822:0:24286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947189.662829:0:24286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 6 pid: 24232 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.662841:0:24286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 6 pid: 24232 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.662892:0:24286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f129 expref: 6 pid: 24232 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.662909:0:24286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:2.0:1790947189.662915:0:24286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.662924:0:24286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.662931:0:24286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.662957:0:24286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947189.662998:0:24286:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d5d97ab-7494-4872-819e-977ae754088f+5:2404:x1877943573962624:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 192us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.663005:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:2.0:1790947189.663040:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790947189.665446:0:22754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.665466:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.665506:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.665523:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.666482:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.671656:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.671690:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.671705:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790947189.671726:0:22754:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006728422 reply state 000000009ef5debc transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672675:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672692:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:3.0:1790947189.672694:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790947189.672702:0:22754:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790947189.672710:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790947189.672723:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672842:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672853:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672921:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.672942:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672952:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672965:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128b00) 00010000:00010000:3.0:1790947189.672968:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.672973:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.672980:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df0c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790947189.673008:0:22754:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006728422 reply state 000000009ef5debc transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.673019:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.673034:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94b0c6680d00) 00010000:00010000:3.0:1790947189.673037:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790947189.673039:0:22754:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790947189.673307:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+10:18667:x1877943573962496:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 22568us (22793us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790947189.673318:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:3.0:1790947189.732248:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.732354:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573962752 00000100:00100000:1.0:1790947189.732365:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573962752 00000100:00100000:1.0:1790947189.732425:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1790947189.732434:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+10:18675:x1877943573962752:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:1.0:1790947189.732457:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947189.732479:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df0d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f145 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.732543:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601000/0xe6f6b79c2d6df0e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.732558:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601000/0xe6f6b79c2d6df0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.732571:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601000/0xe6f6b79c2d6df0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790947189.732635:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790947189.732639:0:24232:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790947189.732693:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601000/0xe6f6b79c2d6df0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.732719:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df0d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f145 expref: 12 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.732750:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601000/0xe6f6b79c2d6df0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f145 expref: 11 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.732759:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:1.0:1790947189.732762:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790947189.732765:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7601000, rc 0) 00000100:00100000:1.0:1790947189.732842:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+11:18675:x1877943573962752:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 409us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.732850:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1790947189.759551:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.759838:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573962880 00000100:00100000:0.0:1790947189.759848:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573962880 00000100:00100000:0.0:1790947189.759939:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1790947189.759950:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+5:18676:x1877943573962880:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1790947189.759971:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947189.759994:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f14c expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.760064:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25800/0xe6f6b79c2d6df0ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.760078:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25800/0xe6f6b79c2d6df0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.760092:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25800/0xe6f6b79c2d6df0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790947189.760133:0:22752:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790947189.760137:0:22752:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790947189.760158:0:22752:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25800/0xe6f6b79c2d6df0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.760180:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f14c expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.760220:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25800/0xe6f6b79c2d6df0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f14c expref: 6 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.760227:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:0.0:1790947189.760230:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790947189.760233:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e25800, rc 0) 00000100:00100000:0.0:1790947189.761789:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+6:18676:x1877943573962880:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1833us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.761800:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1790947189.769679:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 10000000:01000000:3.0:1790947189.773952:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790947189.773959:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1ef870800 from 13 10000000:01000000:3.0:1790947189.773965:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790947189.774013:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.774052:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.774064:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947189.774088:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594001792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790947189.774156:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947189.774241:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001792 00000100:00100000:2.0:1790947189.774250:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001792 00000100:00100000:2.0:1790947189.774297:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790947189.774307:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+20:22749:x1877943594001792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947189.774321:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947189.774335:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6df0fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6df0f5 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.774359:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6df0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df0f5 expref: 21 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.774371:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ef223600/0xe6f6b79c2d6df0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df0f5 expref: 21 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.774380:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223600, rc 0) 00000100:00100000:2.0:1790947189.774427:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943594001792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.774442:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790947189.775706:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c56b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1790947189.775739:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594001792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947189.775825:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df0fc expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.775836:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6df0fc expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947189.775967:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573963008 00000100:00100000:1.0:1790947189.775974:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573963008 00000100:00100000:1.0:1790947189.776032:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1790947189.776042:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+6:18676:x1877943573963008:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1790947189.776058:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947189.776075:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f153 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947189.776085:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1fd0f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594001920:0@lo:501:ll_cfg_requeue.0 00010000:00010000:1.0:1790947189.776133:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947189.776141:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790947189.776168:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947189.776171:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1c56b1240 going to sleep for 11 seconds 00010000:00010000:1.0:1790947189.776182:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947189.776195:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594001920 00010000:00010000:1.0:1790947189.776197:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947189.776200:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594001920 00000100:00100000:3.0:1790947189.776229:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790947189.776236:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943594001920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790947189.776350:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943594001920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.776356:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00010000:1.0:1790947189.776629:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776639:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776775:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600400/0xe6f6b79c2d6df118 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776784:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600400/0xe6f6b79c2d6df118 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776792:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600400/0xe6f6b79c2d6df118 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790947189.776921:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790947189.776925:0:24232:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790947189.776950:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600400/0xe6f6b79c2d6df118 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776961:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776979:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776985:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.776991:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7600000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1790947189.776996:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777004:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777017:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:1.0:1790947189.777021:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790947189.777036:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777042:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777055:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777061:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777066:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777071:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1790947189.777081:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777087:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777095:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94b0c6680d00) 00010000:00010000:1.0:1790947189.777097:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790947189.777100:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777106:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777135:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f153 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777148:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600400/0xe6f6b79c2d6df118 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f153 expref: 7 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.777155:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:1.0:1790947189.777157:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790947189.777159:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600400, rc 0) 00000100:00100000:0.0:1790947189.777350:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1fd0f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594001920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.777404:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.777455:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947189.777480:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1d7e863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947189.777601:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002048 00000100:00100000:2.0:1790947189.777607:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002048 00000100:00100000:2.0:1790947189.777650:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790947189.777663:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943594002048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790947189.777767:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943594002048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.777774:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790947189.777985:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.778790:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+7:18676:x1877943573963008:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2744us (9115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.778799:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000040:00080000:3.0:1790947189.784116:0:25799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790947189.785452:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790947189.785484:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790947189.785496:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df0fc expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.785508:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b1f6c29e00/0xe6f6b79c2d6df0f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df0fc expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947189.785519:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790947189.785522:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1fcd76000 from 13 10000000:01000000:0.0:1790947189.785524:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790947189.785577:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.785585:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.785596:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947189.785621:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.785684:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947189.785727:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6d84900 going to sleep for 11 seconds 00000100:00100000:3.0:1790947189.786110:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002176 00000100:00100000:3.0:1790947189.786119:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002176 00000100:00100000:3.0:1790947189.786161:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790947189.786170:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+21:22749:x1877943594002176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947189.786185:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.786197:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6df126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6df11f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.786515:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6df126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df11f expref: 22 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.786527:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1f6c29400/0xe6f6b79c2d6df126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df11f expref: 22 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.786535:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1f6c29400, rc 0) 00000100:00100000:3.0:1790947189.786639:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943594002176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 469us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.786647:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790947189.789083:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.789179:0:22764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573963136 00000100:00100000:0.0:1790947189.789190:0:22764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573963136 00000100:00100000:0.0:1790947189.789270:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1790947189.789280:0:22764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1d5d97ab-7494-4872-819e-977ae754088f+5:18676:x1877943573963136:12345-192.168.203.29@tcp:900:lfs.0 00000100:00100000:0.0:1790947189.789361:0:22764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1d5d97ab-7494-4872-819e-977ae754088f+5:18676:x1877943573963136:12345-192.168.203.29@tcp:900:lfs.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.789368:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00080000:2.0:1790947189.789608:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790947189.796957:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.797075:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573963392 00000100:00100000:2.0:1790947189.797086:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573963392 00000100:00100000:2.0:1790947189.797150:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1790947189.797160:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+7:18676:x1877943573963392:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1790947189.797182:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947189.797202:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df12d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f15a expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790947189.797314:0:22752:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790947189.797436:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df12d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f15a expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.797455:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:2.0:1790947189.797458:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790947189.797464:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df12d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f15a expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.797479:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222600, rc 0) 00000100:00100000:2.0:1790947189.797542:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d5d97ab-7494-4872-819e-977ae754088f+8:18676:x1877943573963392:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 384us (594us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1790947189.797550:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1790947189.797971:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790947189.797992:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df126 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.798021:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6df126 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947189.798114:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.798157:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947189.798194:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c76ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1790947189.798516:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002304 00000100:00100000:3.0:1790947189.798523:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002304 00000100:00100000:3.0:1790947189.798558:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790947189.798566:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943594002304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790947189.798677:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943594002304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.798684:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790947189.799683:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.799732:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.799791:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947189.799833:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002432 00000100:00100000:3.0:1790947189.799845:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002432 00000100:00100000:3.0:1790947189.799943:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790947189.799952:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c84fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943594002432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790947189.800063:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c84fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943594002432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.800070:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790947189.805260:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c76ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1790947189.805298:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790947189.807130:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790947189.807527:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790947189.807553:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790947189.807565:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df126 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.807578:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b0c7e24a00/0xe6f6b79c2d6df11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df126 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790947189.807589:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790947189.807604:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b0c7116800 from 13 10000000:01000000:0.0:1790947189.807607:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790947189.807643:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.807651:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.807661:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947189.807685:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.807850:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947189.808277:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6d84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790947189.808327:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002560 00000100:00100000:3.0:1790947189.808336:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002560 00000100:00100000:3.0:1790947189.808427:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790947189.808437:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+22:22749:x1877943594002560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947189.808450:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.808463:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1c13ce800/0xe6f6b79c2d6df142 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6df13b expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.808486:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1c13ce800/0xe6f6b79c2d6df142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df13b expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.808496:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1c13ce800/0xe6f6b79c2d6df142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df13b expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.808505:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13ce800, rc 0) 00000100:00100000:3.0:1790947189.808559:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943594002560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.808565:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790947189.808641:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790947189.808658:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df142 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.808667:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6df142 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947189.808729:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.808770:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947189.809440:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c76aba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790947189.809545:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.809608:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573963648 00000100:00100000:1.0:1790947189.809615:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573963648 00000100:00100000:1.0:1790947189.809673:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1790947189.809681:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+8:18676:x1877943573963648:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:1.0:1790947189.809731:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947189.809763:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600400/0xe6f6b79c2d6df118 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f153 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.809779:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:1.0:1790947189.809783:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790947189.809802:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.809814:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.809822:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790947189.810636:0:22753:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000f90f826 reply state 00000000031ce506 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.810655:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.810662:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:1.0:1790947189.810665:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790947189.810667:0:22753:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790947189.810676:0:22753:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790947189.810764:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+9:18676:x1877943573963648:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 1082us (1219us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1790947189.810772:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1790947189.811496:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002688 00000100:00100000:0.0:1790947189.811504:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002688 00000100:00100000:0.0:1790947189.811538:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790947189.811546:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943594002688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.811727:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943594002688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.811791:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790947189.812046:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.812151:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.812200:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947189.812269:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6d84780 going to sleep for 11 seconds 00000100:00100000:3.0:1790947189.816222:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002816 00000100:00100000:3.0:1790947189.816239:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002816 00000100:00100000:2.0:1790947189.819778:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.819812:0:22755:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573963904 00000100:00100000:2.0:1790947189.819821:0:22755:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573963904 00000100:00100000:2.0:1790947189.819899:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1790947189.819909:0:22755:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d5d97ab-7494-4872-819e-977ae754088f+9:18676:x1877943573963904:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1790947189.820137:0:22755:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d5d97ab-7494-4872-819e-977ae754088f+10:18676:x1877943573963904:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 230us (367us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1790947189.820144:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1790947189.821107:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790947189.821193:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943594002816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.821365:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943594002816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (9164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.821373:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790947189.821473:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790947189.823346:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.823419:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573964160 00000100:00100000:3.0:1790947189.823429:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573964160 00000100:00100000:3.0:1790947189.823489:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:3.0:1790947189.823511:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d5d97ab-7494-4872-819e-977ae754088f+10:18676:x1877943573964160:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1790947189.823534:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.823552:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f161 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.823634:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.823648:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.823658:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.823669:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.823676:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.823682:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947189.823929:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790947189.824003:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824012:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824019:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824051:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cec00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.824055:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824062:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824073:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:3.0:1790947189.824076:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.824081:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824087:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824100:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824106:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824112:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824116:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb46000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947189.824118:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824124:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824141:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94b0c6680d00) 00010000:00010000:3.0:1790947189.824143:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947189.824146:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824152:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46000/0xe6f6b79c2d6df15e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824183:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df150 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f161 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824192:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:3.0:1790947189.824194:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790947189.824198:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f161 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.824206:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cea00, rc 0) 00000100:00100000:3.0:1790947189.824267:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d5d97ab-7494-4872-819e-977ae754088f+11:18676:x1877943573964160:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 757us (928us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1790947189.824274:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000040:00080000:3.0:1790947189.826557:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790947189.826846:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790947189.826909:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790947189.826934:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df142 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.826947:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b0c7e25a00/0xe6f6b79c2d6df13b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df142 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790947189.826958:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790947189.826961:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94b1fcde2000 from 13 10000000:01000000:1.0:1790947189.826964:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790947189.827005:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.827013:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.827034:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947189.827059:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.827123:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790947189.827211:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c76ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1790947189.831972:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.838853:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.839001:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573964416 00000100:00100000:1.0:1790947189.839011:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573964416 00000100:00100000:1.0:1790947189.839069:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:1.0:1790947189.839090:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+11:18676:x1877943573964416:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1790947189.839113:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947189.839131:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df173 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f16f expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.839214:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.839228:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.839238:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790947189.839258:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790947189.839261:0:24232:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790947189.839278:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.839300:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df173 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 13 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.839317:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 12 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.839325:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:1.0:1790947189.839328:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790947189.839331:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600000, rc 0) 00000100:00100000:1.0:1790947189.839377:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d5d97ab-7494-4872-819e-977ae754088f+12:18676:x1877943573964416:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 288us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.839391:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1790947189.841592:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594002944 00000100:00100000:0.0:1790947189.841606:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594002944 00000100:00100000:0.0:1790947189.841699:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573964288 00000100:00100000:0.0:1790947189.841707:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573964288 00000100:00100000:3.0:1790947189.841852:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790947189.841885:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+23:22749:x1877943594002944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947189.841904:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.841928:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ecb46000/0xe6f6b79c2d6df181 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6f6b79c2d6df16c expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.841976:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ecb46000/0xe6f6b79c2d6df181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df16c expref: 24 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.841986:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ecb46000/0xe6f6b79c2d6df181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6f6b79c2d6df16c expref: 24 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.841995:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46000, rc 0) 00000100:00100000:3.0:1790947189.842075:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943594002944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (14952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.842082:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790947189.842113:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:3.0:1790947189.842120:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+11:18043:x1877943573964288:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790947189.842127:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.842134:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b1ecb47200/0xe6f6b79c2d6df188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f168 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.842148:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b1ecb47200/0xe6f6b79c2d6df188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f168 expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.842157:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b1ecb47200/0xe6f6b79c2d6df188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f168 expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.842163:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb47200, rc 0) 00000100:00100000:3.0:1790947189.842198:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+12:18043:x1877943573964288:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 78us (10238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.842205:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:2.0:1790947189.842297:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8440e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594002944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790947189.842314:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df181 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.842323:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6f6b79c2d6df181 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947189.842393:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594003072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790947189.842425:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947189.848085:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41600 going to sleep for 11 seconds 00000100:00100000:1.0:1790947189.848671:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003072 00000100:00100000:1.0:1790947189.848682:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003072 00000100:00100000:1.0:1790947189.848736:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790947189.848745:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943594003072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.848912:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943594003072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (6486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.848921:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790947189.849042:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594003072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790947189.849090:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594003200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790947189.849225:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947189.849254:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41600 going to sleep for 11 seconds 00000100:00100000:2.0:1790947189.849304:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.849324:0:22755:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573964544 00000100:00100000:2.0:1790947189.849328:0:22755:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573964544 00000100:00100000:2.0:1790947189.849355:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1790947189.849362:0:22755:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d5d97ab-7494-4872-819e-977ae754088f+12:18676:x1877943573964544:12345-192.168.203.29@tcp:37:lfs.0 00000100:00100000:1.0:1790947189.851876:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003200 00000100:00100000:1.0:1790947189.851894:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003200 00000100:00100000:1.0:1790947189.851946:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790947189.851956:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943594003200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.852139:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:22749:x1877943594003200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.852147:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790947189.852332:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:22749:1877943594003200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790947189.854627:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790947189.856771:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790947189.856811:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790947189.856824:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df181 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.856837:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff94b0c7600400/0xe6f6b79c2d6df16c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6f6b79c2d6df181 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947189.857262:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.857340:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573964672 00000100:00100000:1.0:1790947189.857350:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573964672 00000100:00100000:1.0:1790947189.857400:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 161 00000100:00100000:1.0:1790947189.857411:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+12:18043:x1877943573964672:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790947189.857569:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+12:18043:x1877943573964672:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 159us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947189.857577:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 161 00000100:00100000:2.0:1790947189.863598:0:22755:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d5d97ab-7494-4872-819e-977ae754088f+12:18676:x1877943573964544:12345-192.168.203.29@tcp:37:lfs.0 Request processed in 14224us (14283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.863611:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1790947189.869451:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.870767:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573964800 00000100:00100000:3.0:1790947189.870782:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573964800 00000100:00100000:3.0:1790947189.870847:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:3.0:1790947189.870880:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+12:18043:x1877943573964800:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790947189.871234:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+12:18043:x1877943573964800:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 377us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.871244:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:2.0:1790947189.882242:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.883092:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965056 00000100:00100000:3.0:1790947189.883104:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965056 00000100:00100000:3.0:1790947189.887517:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1790947189.887540:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d5d97ab-7494-4872-819e-977ae754088f+12:18676:x1877943573965056:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1790947189.887840:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d5d97ab-7494-4872-819e-977ae754088f+13:18676:x1877943573965056:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 309us (5607us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1790947189.887849:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1790947189.888254:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.889332:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965184 00000100:00100000:0.0:1790947189.889342:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965184 00000100:00100000:0.0:1790947189.889444:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1790947189.889453:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+12:18043:x1877943573965184:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790947189.889469:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947189.889486:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94b0c7e24e00/0xe6f6b79c2d6df18f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f176 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.889515:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94b0c7e24e00/0xe6f6b79c2d6df18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f176 expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.889528:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94b0c7e24e00/0xe6f6b79c2d6df18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f176 expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947189.889541:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e24e00, rc 0) 00000100:00100000:0.0:1790947189.889610:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+13:18043:x1877943573965184:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 149us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.889617:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1790947189.894260:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.894308:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965312 00000100:00100000:3.0:1790947189.894318:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965312 00000100:00100000:3.0:1790947189.894374:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:3.0:1790947189.894385:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+13:18043:x1877943573965312:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790947189.894535:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bce661d0-1e50-4766-a156-91ae28874164+13:18043:x1877943573965312:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 151us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.894543:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:2.0:1790947189.900147:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.900347:0:22744:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965440 00000100:00100000:0.0:1790947189.900357:0:22744:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965440 00000100:00100000:0.0:1790947189.900412:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:0.0:1790947189.900423:0:22744:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+13:18043:x1877943573965440:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790947189.900561:0:22744:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bce661d0-1e50-4766-a156-91ae28874164+13:18043:x1877943573965440:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 140us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.900577:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 165 00000040:00080000:2.0:1790947189.902486:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790947189.939638:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.940682:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965568 00000100:00100000:3.0:1790947189.940694:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965568 00000100:00100000:2.0:1790947189.941061:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:2.0:1790947189.941074:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+11:18684:x1877943573965568:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1790947189.941095:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947189.941114:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f17d expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941179:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941204:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941228:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941240:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941247:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941254:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941331:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222400/0xe6f6b79c2d6df1ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941341:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222400/0xe6f6b79c2d6df1ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941347:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222400/0xe6f6b79c2d6df1ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790947189.941379:0:22752:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790947189.941382:0:22752:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790947189.941417:0:22752:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222400/0xe6f6b79c2d6df1ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941427:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941434:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941452:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941459:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222800 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947189.941463:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941471:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941482:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:2.0:1790947189.941486:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790947189.941490:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941496:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df19d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941507:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941513:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941518:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941522:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947189.941525:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941540:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941548:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94b0c6680d00) 00010000:00010000:2.0:1790947189.941550:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790947189.941553:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941559:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941585:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f17d expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941600:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222400/0xe6f6b79c2d6df1ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f17d expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.941617:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:2.0:1790947189.941620:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790947189.941622:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222400, rc 0) 00000100:00100000:2.0:1790947189.941694:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+12:18684:x1877943573965568:12345-192.168.203.29@tcp:101:bash.0 Request processed in 623us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.941710:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:2.0:1790947189.947843:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947189.949214:0:22764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965696 00000100:00100000:0.0:1790947189.949227:0:22764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965696 00000100:00100000:0.0:1790947189.949345:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1790947189.949365:0:22764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:570e5cec-6181-4423-9892-8b4e68369024+5:18684:x1877943573965696:12345-192.168.203.29@tcp:900:bash.0 00000100:00100000:0.0:1790947189.949458:0:22764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:570e5cec-6181-4423-9892-8b4e68369024+5:18684:x1877943573965696:12345-192.168.203.29@tcp:900:bash.0 Request processed in 104us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947189.949465:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1790947189.953943:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947189.954033:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573965952 00000100:00100000:1.0:1790947189.954044:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573965952 00000100:00100000:1.0:1790947189.954104:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1790947189.954114:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+12:18684:x1877943573965952:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1790947189.954135:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947189.954158:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df1b2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f184 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.954260:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.954276:0:24232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 12 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.954284:0:24232:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.954318:0:24232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 12 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947189.954332:0:24232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 12 pid: 24232 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947189.954344:0:24232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1eee0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24232:1877943594003328:192.168.203.29@tcp:104: 00000100:00100000:1.0:1790947189.954435:0:24232:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c76ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947189.957335:0:24232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1eee0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24232:1877943594003328:192.168.203.29@tcp:104: 00010000:00010000:2.0:1790947189.957368:0:24232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947189.959192:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947189.959504:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573966080 00000100:00100000:2.0:1790947189.959514:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573966080 00010000:00010000:2.0:1790947189.959552:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 13 pid: 24232 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947189.959594:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1790947189.959604:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d5d97ab-7494-4872-819e-977ae754088f+13:2404:x1877943573966080:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947189.959619:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947189.959626:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 13 pid: 24232 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.959639:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 13 pid: 24232 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.959659:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600000/0xe6f6b79c2d6df17a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f16f expref: 13 pid: 24232 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.959674:0:22739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:2.0:1790947189.959678:0:22739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.959687:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.959694:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.959784:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947189.959851:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d5d97ab-7494-4872-819e-977ae754088f+12:2404:x1877943573966080:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 247us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947189.960079:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00010000:00010000:3.0:1790947189.963092:0:24232:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.963108:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.963295:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.963310:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.963321:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964188:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964201:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964210:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790947189.964221:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790947189.964246:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964253:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964260:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964265:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947189.964269:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964286:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964298:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:2.0:1790947189.964301:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790947189.964305:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964311:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df1b9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790947189.964323:0:24232:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ff131fda reply state 0000000009346bcf transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964332:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964337:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94b1c93f9a00) 00010000:00010000:2.0:1790947189.964339:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790947189.964342:0:24232:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790947189.964453:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df1b2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 15 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964469:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 14 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947189.964476:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:2.0:1790947189.964478:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790947189.964480:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223e00, rc 0) 00000100:00100000:2.0:1790947189.964597:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+15:18684:x1877943573965952:12345-192.168.203.29@tcp:101:bash.0 Request processed in 10484us (10662us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1790947189.964605:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:0.0:1790947189.988395:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.988483:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573966208 00000100:00100000:3.0:1790947189.988494:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573966208 00000100:00100000:3.0:1790947189.988684:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:3.0:1790947189.988696:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+15:18684:x1877943573966208:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1790947189.988720:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947189.988740:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df1d5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f18b expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.988805:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.988820:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.988831:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947189.988916:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790947189.988920:0:22754:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790947189.988940:0:22754:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.988951:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.988976:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df1d5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f18b expref: 17 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.988995:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f18b expref: 16 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947189.989029:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947189.989033:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790947189.989036:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb47e00, rc 0) 00000100:00100000:3.0:1790947189.989087:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+16:18684:x1877943573966208:12345-192.168.203.29@tcp:101:bash.0 Request processed in 394us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947189.989093:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:1.0:1790947189.994288:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947189.994362:0:22755:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573966464 00000100:00100000:3.0:1790947189.994371:0:22755:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573966464 00000100:00100000:3.0:1790947189.994426:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1790947189.994436:0:22755:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+16:18684:x1877943573966464:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1790947189.995505:0:22755:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+17:18684:x1877943573966464:12345-192.168.203.29@tcp:35:bash.0 Request processed in 300us (455us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1790947189.995518:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1790947190.107154:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947190.107244:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573966720 00000100:00100000:2.0:1790947190.107254:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573966720 00000100:00100000:2.0:1790947190.107319:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:2.0:1790947190.107329:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+17:18694:x1877943573966720:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1790947190.107353:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947190.107374:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df1e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f192 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790947190.107472:0:22753:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790947190.107579:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df1e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f192 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.107593:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:2.0:1790947190.107596:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790947190.107601:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222800/0xe6f6b79c2d6df1e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f192 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.107614:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222800, rc 0) 00000100:00100000:2.0:1790947190.107665:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+18:18694:x1877943573966720:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 339us (520us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1790947190.107672:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1790947190.113260:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947190.113349:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573966976 00000100:00100000:0.0:1790947190.113360:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573966976 00000100:00100000:0.0:1790947190.113416:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1790947190.113425:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+18:18694:x1877943573966976:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1790947190.113655:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+19:18694:x1877943573966976:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 230us (405us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1790947190.113663:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1790947190.196268:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947190.196433:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573967232 00000100:00100000:2.0:1790947190.196443:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573967232 00000100:00100000:2.0:1790947190.196505:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1790947190.196516:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+19:18697:x1877943573967232:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1790947190.196549:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947190.196571:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df1f1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f199 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.196675:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223000/0xe6f6b79c2d6df1f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.196691:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223000/0xe6f6b79c2d6df1f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.196704:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223000/0xe6f6b79c2d6df1f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790947190.196715:0:22752:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790947190.196822:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df1f1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f199 expref: 22 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.196840:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223000/0xe6f6b79c2d6df1f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f199 expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.196849:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:2.0:1790947190.196852:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790947190.196908:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef223000, rc 0) 00000100:00100000:2.0:1790947190.196969:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+21:18697:x1877943573967232:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 455us (709us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1790947190.196976:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1790947190.203839:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.203902:0:24286:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573967360 00000100:00100000:3.0:1790947190.203924:0:24286:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573967360 00000100:00100000:3.0:1790947190.203987:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1790947190.203996:0:24286:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:570e5cec-6181-4423-9892-8b4e68369024+21:2405:x1877943573967360:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947190.204012:0:24286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947190.204045:0:24286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223000/0xe6f6b79c2d6df1f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f199 expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.204074:0:24286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.204079:0:24286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947190.204131:0:24286:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:570e5cec-6181-4423-9892-8b4e68369024+20:2405:x1877943573967360:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.204550:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1790947190.210476:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947190.213316:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573967488 00000100:00100000:2.0:1790947190.213331:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573967488 00000100:00100000:2.0:1790947190.213438:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1790947190.213449:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+20:18697:x1877943573967488:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1790947190.213516:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213534:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213545:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213580:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213588:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213594:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213600:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947190.213605:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213613:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213625:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:2.0:1790947190.213629:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790947190.213634:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947190.213651:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222600/0xe6f6b79c2d6df206 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947190.213735:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+20:18697:x1877943573967488:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 287us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947190.213743:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:1.0:1790947190.224688:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947190.224950:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573967744 00000100:00100000:0.0:1790947190.224961:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573967744 00000100:00100000:0.0:1790947190.225030:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1790947190.225040:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+20:18697:x1877943573967744:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1790947190.226036:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+21:18697:x1877943573967744:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 256us (615us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1790947190.226065:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000040:00080000:2.0:1790947190.415922:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790947190.478031:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790947190.478054:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1eee0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594003456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790947190.478119:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947190.478164:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594003584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790947190.478185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947190.478702:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943594003840:0@lo:400:kworker.0 00000100:00100000:2.0:1790947190.478728:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.478855:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594003712:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.478902:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947190.478934:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003456 00000100:00100000:3.0:1790947190.478936:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943594004224:0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.478944:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003456 00000100:00100000:3.0:1790947190.478962:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877943594004096:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.478985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.479006:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943594004608:0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.479009:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003584 00000100:00100000:0.0:1790947190.479014:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003584 00000100:00100000:3.0:1790947190.479044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947190.479050:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790947190.479060:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594003456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947190.479064:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790947190.479071:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943594003968:0@lo:400:kworker.0 00002000:00000024:0.0:1790947190.479091:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790947190.479097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.479112:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943594004480:0@lo:400:kworker.0 00000100:00100000:1.0:1790947190.479182:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003968 00000100:00100000:1.0:1790947190.479187:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003968 00000100:00100000:1.0:1790947190.479217:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790947190.479224:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f5f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943594003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.479500:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.479519:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1877943594004992:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.479540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.479564:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003840 00000100:00100000:3.0:1790947190.479568:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003840 00000100:00100000:0.0:1790947190.482172:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594003456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3104us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.482231:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790947190.482266:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790947190.482345:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943594003584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790947190.482371:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790947190.482537:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943594003584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (4350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.482545:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790947190.482570:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790947190.482575:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790947190.482586:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004096 00000100:00100000:0.0:1790947190.482592:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004096 00000100:00100000:0.0:1790947190.482618:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004608 00000100:00100000:0.0:1790947190.482622:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004608 00000100:00080000:0.0:1790947190.482643:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790947190.482654:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004480 00000100:00100000:0.0:1790947190.482656:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004480 00000100:00100000:0.0:1790947190.482666:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004992 00000100:00100000:0.0:1790947190.482669:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004992 00000100:00080000:0.0:1790947190.482692:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790947190.482708:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790947190.482714:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877943594004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.482757:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1877943594004096:12345-0@lo:400:kworker.0 Request processed in 43us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.482764:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790947190.482921:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790947190.482929:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1fd0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943594004608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.482960:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1fd0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1877943594004608:12345-0@lo:400:kworker.0 Request processed in 33us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.482966:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790947190.482977:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790947190.482983:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943594004480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.483537:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1877943594004480:12345-0@lo:400:kworker.0 Request processed in 552us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.483545:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790947190.483560:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790947190.483568:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c70bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877943594004992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.483602:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c70bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1877943594004992:12345-0@lo:400:kworker.0 Request processed in 36us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.483608:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790947190.483693:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1877943594004480:0@lo:400:kworker.0 00010000:00080000:0.0:1790947190.483707:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c8504000 x1877943594004992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790947190.483718:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1877943594004992:0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.483743:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1877943594004096:0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.483753:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1877943594004608:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.483952:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790947190.483964:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943594003840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.484008:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877943594003840:12345-0@lo:400:kworker.0 Request processed in 48us (5279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.484015:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790947190.484071:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.484104:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943594004736:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.484144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947190.484188:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004224 00000100:00100000:3.0:1790947190.484193:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004224 00000100:00100000:3.0:1790947190.484220:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790947190.484226:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943594004224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.484261:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943594004224:12345-0@lo:400:kworker.0 Request processed in 36us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.484268:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790947190.484292:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943594004224:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.484325:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1eee0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594003456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947190.484338:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594003584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790947190.484368:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004736 00000100:00100000:3.0:1790947190.484372:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004736 00000100:00100000:3.0:1790947190.484400:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790947190.484406:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943594004736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.484437:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877943594004736:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.484442:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1790947190.484456:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790947190.484476:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b0c8507480 x1877943594004736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947190.484487:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1877943594004736:0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.484498:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594003712 00000100:00100000:0.0:1790947190.484504:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594003712 00000100:00100000:0.0:1790947190.484538:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790947190.484545:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943594003712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.484609:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943594003712:12345-0@lo:400:kworker.0 Request processed in 64us (5705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.484615:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790947190.484940:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594003712:0@lo:400:kworker.0 00000100:00100000:2.0:1790947190.485039:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943594003840:0@lo:400:kworker.0 00000100:00100000:2.0:1790947190.485048:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943594004352:0@lo:400:kworker.0 00000100:00100000:2.0:1790947190.485078:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947190.485109:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1877943594004864:0@lo:400:kworker.0 00000100:00100000:2.0:1790947190.485132:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947190.485346:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004352 00000100:00100000:0.0:1790947190.485351:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004352 00000100:00100000:0.0:1790947190.485393:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790947190.485400:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943594004352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947190.485440:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943594004352:12345-0@lo:400:kworker.0 Request processed in 40us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947190.485445:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790947190.485507:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947190.485528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943594004352:0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.485839:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594004864 00000100:00100000:3.0:1790947190.485853:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594004864 00000100:00100000:3.0:1790947190.485919:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790947190.485925:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877943594004864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947190.485965:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877943594004864:12345-0@lo:400:kworker.0 Request processed in 39us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.485970:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1790947190.486029:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790947190.486049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1877943594004864:0@lo:400:kworker.0 00000100:00100000:1.0:1790947190.488315:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f5f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943594003968:12345-0@lo:400:kworker.0 Request processed in 9082us (9208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947190.488329:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790947190.488481:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943594003968:0@lo:400:kworker.0 00010000:00010000:3.0:1790947190.607543:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947190.663350:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.663444:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573968000 00000100:00100000:3.0:1790947190.663455:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573968000 00000100:00100000:3.0:1790947190.663521:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:3.0:1790947190.663531:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+21:18728:x1877943573968000:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1790947190.663559:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947190.663580:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df20d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.663701:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df214 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.663715:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df214 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.663727:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df214 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947190.663748:0:22752:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790947190.663902:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df20d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1a0 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.663923:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df214 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1a0 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.663946:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.663949:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790947190.663953:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46200, rc 0) 00000100:00100000:3.0:1790947190.664023:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+23:18728:x1877943573968000:12345-192.168.203.29@tcp:101:cat.0 Request processed in 486us (675us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1790947190.664030:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1790947190.671883:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.688436:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573968256 00000100:00100000:3.0:1790947190.688452:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573968256 00000100:00100000:3.0:1790947190.688520:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:3.0:1790947190.688531:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+23:18728:x1877943573968256:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:3.0:1790947190.688900:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+24:18728:x1877943573968256:12345-192.168.203.29@tcp:35:cat.0 Request processed in 370us (17053us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1790947190.688921:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1790947190.689852:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.691232:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573968384 00000100:00100000:3.0:1790947190.691245:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573968384 00000100:00100000:3.0:1790947190.691367:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1790947190.691379:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+24:2404:x1877943573968384:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947190.691396:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947190.691419:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df214 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1a0 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.691438:0:22739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.691443:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947190.691505:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+23:2404:x1877943573968384:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 128us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.691526:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1790947190.824159:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.824485:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573968640 00000100:00100000:3.0:1790947190.824495:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573968640 00000100:00100000:3.0:1790947190.824618:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:3.0:1790947190.824629:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+23:18734:x1877943573968640:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:3.0:1790947190.824654:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947190.824674:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df222 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1a7 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.824789:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df229 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.824805:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df229 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.824816:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df229 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947190.824827:0:22753:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790947190.824994:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df222 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1a7 expref: 26 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.825027:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df229 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1a7 expref: 25 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.825037:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.825040:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790947190.825043:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb47600, rc 0) 00000100:00100000:3.0:1790947190.825129:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+25:18734:x1877943573968640:12345-192.168.203.29@tcp:101:dd.0 Request processed in 501us (977us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1790947190.825137:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:2.0:1790947190.830693:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.830831:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573968768 00000100:00100000:3.0:1790947190.830841:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573968768 00000100:00100000:3.0:1790947190.830926:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1790947190.830937:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:570e5cec-6181-4423-9892-8b4e68369024+25:2405:x1877943573968768:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947190.830952:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947190.830978:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df229 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1a7 expref: 25 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.830998:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.831003:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947190.831063:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:570e5cec-6181-4423-9892-8b4e68369024+24:2405:x1877943573968768:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.831070:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1790947190.833428:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.833503:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573968896 00000100:00100000:3.0:1790947190.833523:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573968896 00000100:00100000:3.0:1790947190.833580:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1790947190.833591:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+24:18734:x1877943573968896:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:3.0:1790947190.833622:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947190.833642:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df237 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1ae expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.833677:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.833692:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.833717:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.833834:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df237 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 26 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.833854:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 25 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.833899:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.833902:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790947190.833905:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb47400, rc 0) 00000100:00100000:3.0:1790947190.833966:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+25:18734:x1877943573968896:12345-192.168.203.29@tcp:101:dd.0 Request processed in 376us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947190.833973:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1790947190.846509:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947190.847148:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573969152 00000100:00100000:3.0:1790947190.847158:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573969152 00000100:00100000:3.0:1790947190.847221:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:3.0:1790947190.847231:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+25:18734:x1877943573969152:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:3.0:1790947190.847282:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947190.847305:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df1dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f18b expref: 25 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.847325:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.847329:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790947190.847497:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.847540:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.847550:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790947190.847593:0:22754:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1790947190.847629:0:22754:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000be2284c reply state 0000000097f03e54 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.847642:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947190.847648:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947190.847651:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790947190.847654:0:22754:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790947190.847757:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+27:18734:x1877943573969152:12345-192.168.203.29@tcp:36:dd.0 Request processed in 528us (1256us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1790947190.847764:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000020:00080000:3.0:1790947190.847769:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790947191.008850:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947191.009141:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573969408 00000100:00100000:0.0:1790947191.009151:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573969408 00000100:00100000:0.0:1790947191.009219:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1790947191.009229:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+27:18734:x1877943573969408:12345-192.168.203.29@tcp:35:dd.0 00000100:00100000:0.0:1790947191.009454:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+28:18734:x1877943573969408:12345-192.168.203.29@tcp:35:dd.0 Request processed in 226us (610us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1790947191.009488:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:3.0:1790947191.010112:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790947191.257220:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.258521:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573969536 00000100:00100000:3.0:1790947191.258604:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573969536 00000100:00100000:3.0:1790947191.258740:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:3.0:1790947191.258752:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+28:18748:x1877943573969536:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:3.0:1790947191.258777:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947191.258799:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df24c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1b5 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.258909:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.258925:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.258938:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.258951:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.258959:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.258966:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259043:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259052:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259060:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947191.259100:0:22752:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790947191.259104:0:22752:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790947191.259156:0:22752:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259179:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259188:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259196:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259203:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259209:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb47600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947191.259223:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259231:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259242:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:3.0:1790947191.259245:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947191.259250:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259257:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df253 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259272:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259279:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259291:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259297:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb46200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947191.259300:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259306:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259315:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94b1c93f9a00) 00010000:00010000:3.0:1790947191.259317:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947191.259321:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259327:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df25a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259353:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df24c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1b5 expref: 30 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259366:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1b5 expref: 29 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.259374:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.259376:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790947191.259378:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46e00, rc 0) 00000100:00100000:3.0:1790947191.259460:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+29:18748:x1877943573969536:12345-192.168.203.29@tcp:101:stat.0 Request processed in 711us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.259476:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1790947191.324527:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.324627:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573969792 00000100:00100000:3.0:1790947191.324638:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573969792 00000100:00100000:3.0:1790947191.324701:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:3.0:1790947191.324711:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+29:18754:x1877943573969792:12345-192.168.203.29@tcp:36:truncate.0 00010000:00010000:3.0:1790947191.324765:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947191.324790:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df261 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1b5 expref: 29 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.324810:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.324815:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790947191.325044:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.325060:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.325070:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790947191.325113:0:22754:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1790947191.325148:0:22754:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007ecf0ce1 reply state 000000001f7922d0 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.325160:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.325166:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.325169:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790947191.325186:0:22754:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790947191.325468:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+31:18754:x1877943573969792:12345-192.168.203.29@tcp:36:truncate.0 Request processed in 756us (948us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1790947191.325476:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000020:00080000:3.0:1790947191.325482:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790947191.528821:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947191.529073:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573969920 00000100:00100000:0.0:1790947191.529083:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573969920 00000100:00100000:0.0:1790947191.529143:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:0.0:1790947191.529154:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+31:18768:x1877943573969920:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:0.0:1790947191.529179:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947191.529200:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df26f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1bc expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529270:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529285:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529296:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529308:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529315:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529320:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529669:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529691:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529698:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790947191.529741:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1790947191.529746:0:24232:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790947191.529766:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529855:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529902:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529909:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529916:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529922:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947191.529926:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529932:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529944:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:0.0:1790947191.529953:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947191.529958:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529964:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24c00/0xe6f6b79c2d6df276 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529979:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529985:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529991:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.529996:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947191.529999:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.530004:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.530022:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94b1c93f9a00) 00010000:00010000:0.0:1790947191.530025:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947191.530028:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.530034:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df27d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.530063:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df26f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 33 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.530086:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 32 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.530094:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947191.530096:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790947191.530098:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e24000, rc 0) 00000100:00100000:0.0:1790947191.530164:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+32:18768:x1877943573969920:12345-192.168.203.29@tcp:101:stat.0 Request processed in 1011us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947191.530170:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00010000:00010000:0.0:1790947191.632189:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790947191.669454:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.675798:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573970176 00000100:00100000:3.0:1790947191.675815:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573970176 00000100:00100000:3.0:1790947191.675911:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1790947191.675922:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+32:18778:x1877943573970176:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1790947191.675943:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947191.675967:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df28b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1c3 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947191.676075:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790947191.676172:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df28b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1c3 expref: 34 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.676186:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:3.0:1790947191.676190:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790947191.676195:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df28b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1c3 expref: 34 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.676210:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46e00, rc 0) 00000100:00100000:3.0:1790947191.680180:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+33:18778:x1877943573970176:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 4249us (10723us total) trans 12884901910 rc 301/301 00000100:00100000:3.0:1790947191.680193:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:0.0:1790947191.685947:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.686032:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573970432 00000100:00100000:3.0:1790947191.686043:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573970432 00000100:00100000:3.0:1790947191.686115:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1790947191.686473:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c2dce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+33:18778:x1877943573970432:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1790947191.686981:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c2dce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+34:18778:x1877943573970432:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 856us (1044us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1790947191.686991:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1790947191.806989:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947191.807069:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573970688 00000100:00100000:0.0:1790947191.807079:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573970688 00000100:00100000:0.0:1790947191.807144:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:0.0:1790947191.807154:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+34:18784:x1877943573970688:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1790947191.807179:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947191.807199:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df299 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1ca expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.807300:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.807340:0:24232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 35 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.807349:0:24232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 35 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.807357:0:24232:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.808019:0:24232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 35 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.808037:0:24232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 35 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947191.808052:0:24232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24232:1877943594005120:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947191.808199:0:24232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 35 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.808210:0:24232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 35 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947191.808219:0:24232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24232:1877943594005248:192.168.203.29@tcp:104: 00000100:00100000:0.0:1790947191.808243:0:24232:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790947191.814138:0:24232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24232:1877943594005120:192.168.203.29@tcp:104: 00000100:00100000:0.0:1790947191.814153:0:24232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24232:1877943594005248:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947191.814191:0:24232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947191.822640:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947191.822680:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.822764:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573970816 00000100:00100000:3.0:1790947191.822774:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573970816 00010000:00010000:3.0:1790947191.822815:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 36 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947191.822851:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573970944 00000100:00100000:3.0:1790947191.822854:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573970944 00010000:00010000:3.0:1790947191.822890:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 37 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947191.822913:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1790947191.822921:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1d0680850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+37:2404:x1877943573970816:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947191.822935:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947191.822942:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 37 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.822954:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 37 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.822975:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24000/0xe6f6b79c2d6df284 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1bc expref: 37 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.822992:0:22739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.822997:0:22739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823006:0:22739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823042:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947191.823087:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1d0680850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+36:2404:x1877943573970816:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 166us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.823095:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1790947191.823139:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:3.0:1790947191.823146:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+35:2404:x1877943573970944:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947191.823154:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947191.823159:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 35 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823169:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 35 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823181:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df1c7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f184 expref: 35 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823192:0:22739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.823195:0:22739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823202:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823209:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.823231:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947191.823257:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+34:2404:x1877943573970944:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 111us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.823264:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00010000:00010000:0.0:1790947191.824147:0:24232:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.824160:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790947191.824180:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1790947191.824311:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df299 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 35 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.824339:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 34 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.824348:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947191.824350:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790947191.824353:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e24400, rc 0) 00000100:00100000:0.0:1790947191.824408:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+34:18784:x1877943573970688:12345-192.168.203.29@tcp:101:bash.0 Request processed in 17255us (17430us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1790947191.824416:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:2.0:1790947191.831052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.831906:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573971200 00000100:00100000:3.0:1790947191.831917:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573971200 00000100:00100000:3.0:1790947191.831977:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1790947191.831987:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+34:18784:x1877943573971200:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:3.0:1790947191.832201:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.832218:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.832228:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790947191.832287:0:22753:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1790947191.832307:0:22753:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a1c26f56 reply state 00000000824e0a1f transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.832319:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.832326:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.832329:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790947191.832332:0:22753:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790947191.832429:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+37:18784:x1877943573971200:12345-192.168.203.29@tcp:36:bash.0 Request processed in 443us (1385us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1790947191.832436:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000020:00080000:3.0:1790947191.832440:0:22753:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790947191.839890:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.839969:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573971328 00000100:00100000:3.0:1790947191.839978:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573971328 00000100:00100000:3.0:1790947191.840036:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1790947191.840046:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+37:18784:x1877943573971328:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1790947191.840071:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947191.840090:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2b5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1d1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.840146:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1d1 expref: 38 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.840161:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1d1 expref: 38 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.840180:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.840183:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790947191.840187:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46200, rc 0) 00000100:00100000:3.0:1790947191.840247:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+38:18784:x1877943573971328:12345-192.168.203.29@tcp:101:bash.0 Request processed in 203us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.840255:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1790947191.854122:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.854228:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573971456 00000100:00100000:3.0:1790947191.854238:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573971456 00000100:00100000:3.0:1790947191.854301:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1790947191.854311:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+38:18784:x1877943573971456:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1790947191.854333:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947191.854353:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2bc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1d8 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.854512:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.854528:0:22753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 39 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.854537:0:22753:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.854570:0:22753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 39 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.854583:0:22753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 39 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947191.856497:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22753:1877943594005376:192.168.203.29@tcp:104: 00000100:00100000:2.0:1790947191.861062:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6ebda80 going to sleep for 11 seconds 00000100:00100000:0.0:1790947191.869995:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22753:1877943594005376:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947191.870031:0:22753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947191.875902:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.876044:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573971584 00000100:00100000:3.0:1790947191.876054:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573971584 00010000:00010000:3.0:1790947191.876094:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 40 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947191.876136:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1790947191.876147:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+40:2404:x1877943573971584:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947191.876162:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947191.876168:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 40 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.876210:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 40 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.876235:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24400/0xe6f6b79c2d6df2a0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ca expref: 40 pid: 24232 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.876252:0:22739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.876257:0:22739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.876267:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.876275:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.876308:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947191.876363:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+39:2404:x1877943573971584:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 218us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.876371:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00010000:00010000:0.0:1790947191.876643:0:22753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.876666:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790947191.876729:0:22753:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790947191.876734:0:22753:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790947191.876755:0:22753:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.877063:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2bc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1d8 expref: 39 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.877083:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1d8 expref: 38 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.877091:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947191.877094:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790947191.877098:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb47000, rc 0) 00000100:00100000:0.0:1790947191.877133:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+38:18784:x1877943573971456:12345-192.168.203.29@tcp:101:bash.0 Request processed in 22823us (23019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947191.877140:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:2.0:1790947191.891901:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.892074:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573971840 00000100:00100000:3.0:1790947191.892083:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573971840 00000100:00100000:3.0:1790947191.892146:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:3.0:1790947191.892156:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:570e5cec-6181-4423-9892-8b4e68369024+38:18784:x1877943573971840:12345-192.168.203.29@tcp:103:bash.0 00010000:00010000:3.0:1790947191.892172:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790947191.892194:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2b5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1d1 expref: 38 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.892236:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1d8 expref: 37 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.892246:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.892250:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947191.892302:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:570e5cec-6181-4423-9892-8b4e68369024+36:18784:x1877943573971840:12345-192.168.203.29@tcp:103:bash.0 Request processed in 148us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.892310:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1790947191.899222:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.899300:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573971968 00000100:00100000:3.0:1790947191.899309:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573971968 00000100:00100000:3.0:1790947191.899366:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1790947191.899375:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+36:18784:x1877943573971968:12345-192.168.203.29@tcp:58:bash.0 00010000:00010000:3.0:1790947191.899481:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.899499:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.899509:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790947191.909392:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790947191.909437:0:22752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1790947191.909611:0:22752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1790947191.910234:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+36:18784:x1877943573971968:12345-192.168.203.29@tcp:58:bash.0 Request processed in 10803us (10964us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.910250:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:2.0:1790947191.924033:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947191.924160:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573972096 00000100:00100000:0.0:1790947191.924173:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573972096 00000100:00100000:0.0:1790947191.924252:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:0.0:1790947191.924264:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+36:18784:x1877943573972096:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1790947191.924294:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947191.924321:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1df expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.924419:0:22754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.924431:0:22754:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 37 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.924454:0:22754:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.924468:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 37 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.924484:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947191.924488:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790947191.924492:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 37 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947191.924502:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e24800, rc 0) 00000100:00100000:0.0:1790947191.924585:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+37:18784:x1877943573972096:12345-192.168.203.29@tcp:101:bash.0 Request processed in 322us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947191.924593:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000040:00080000:2.0:1790947191.952466:0:22787:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790947191.952478:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790947191.952508:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790947191.952518:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1790947191.952690:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c8504e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22787:1877943594005504:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790947191.952820:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947191.960644:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947191.960761:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573972224 00000100:00100000:1.0:1790947191.960784:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573972224 00000100:00100000:1.0:1790947191.960882:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1790947191.960893:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+38:18785:x1877943573972224:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790947191.960935:0:24232:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790947191.961103:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+38:18785:x1877943573972224:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 211us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947191.961112:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:0.0:1790947191.962443:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c8504e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22787:1877943594005504:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790947191.965271:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947191.965462:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573972352 00000100:00100000:3.0:1790947191.965474:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573972352 00000100:00100000:3.0:1790947191.965549:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1790947191.965560:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+37:18785:x1877943573972352:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790947191.965668:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.965692:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.965708:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970494:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970522:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970535:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970570:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970579:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970586:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947191.970645:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790947191.970660:0:22754:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790947191.970677:0:22754:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970759:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970768:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970775:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970782:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb46200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947191.970786:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970794:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970806:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94b1f4128300) 00010000:00010000:3.0:1790947191.970809:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947191.970814:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970820:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df2d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970838:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.970845:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971034:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971040:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb47600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947191.971043:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971050:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971060:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff94b0c6680400) 00010000:00010000:3.0:1790947191.971062:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947191.971066:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971072:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df2df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971089:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971096:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971102:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971106:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cea00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947191.971109:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971143:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971151:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947191.971154:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790947191.971157:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947191.971163:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df2e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947191.971255:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+37:18785:x1877943573972352:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 5692us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947191.971265:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:2.0:1790947191.983175:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947191.984090:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573972608 00000100:00100000:1.0:1790947191.984101:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573972608 00000100:00100000:1.0:1790947191.984170:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:1.0:1790947191.984181:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+37:18785:x1877943573972608:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790947191.984202:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947191.984221:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df2ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1e6 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984334:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984350:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984360:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790947191.984371:0:24232:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790947191.984438:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984447:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984454:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984459:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1790947191.984463:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984470:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984481:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:1.0:1790947191.984483:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790947191.984487:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984503:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df2f4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984537:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df2ed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1e6 expref: 39 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984547:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94b1f4128300) 00010000:00010000:1.0:1790947191.984549:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790947191.984553:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601200/0xe6f6b79c2d6df2ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1e6 expref: 39 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947191.984562:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7601200, rc 0) 00000100:00100000:1.0:1790947191.984617:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+38:18785:x1877943573972608:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 438us (1451us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1790947191.984625:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:1.0:1790947192.008540:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.008673:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573972736 00000100:00100000:2.0:1790947192.008693:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573972736 00000100:00100000:2.0:1790947192.008752:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1790947192.008762:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+38:18785:x1877943573972736:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790947192.008799:0:22753:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790947192.008962:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+38:18785:x1877943573972736:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 201us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.008970:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1790947192.011460:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.011543:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573972992 00000100:00100000:1.0:1790947192.011551:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573972992 00000100:00100000:1.0:1790947192.011602:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1790947192.011611:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+38:18785:x1877943573972992:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790947192.011630:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947192.011649:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df302 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1ed expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790947192.012021:0:24232:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:1.0:1790947192.012028:0:24232:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:1.0:1790947192.012059:0:24232:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1790947192.012200:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df309 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.012213:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df309 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.012225:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df309 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.012270:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df302 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ed expref: 41 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.012286:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df309 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ed expref: 40 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.012295:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128e00) 00010000:00010000:1.0:1790947192.012297:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790947192.012301:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7601800, rc 0) 00000100:00100000:1.0:1790947192.012359:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+40:18785:x1877943573972992:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 749us (908us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1790947192.012365:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1790947192.031647:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.031747:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573973248 00000100:00100000:2.0:1790947192.031756:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573973248 00000100:00100000:2.0:1790947192.031815:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1790947192.031825:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+40:18785:x1877943573973248:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790947192.031930:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947192.031957:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601800/0xe6f6b79c2d6df309 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ed expref: 40 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.031977:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128e00) 00010000:00010000:2.0:1790947192.031987:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790947192.032019:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032033:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032041:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032095:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032102:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032108:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032453:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032479:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032487:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032493:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef223200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947192.032498:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032505:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032514:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:2.0:1790947192.032518:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790947192.032522:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032528:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223200/0xe6f6b79c2d6df317 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032538:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032544:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032550:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032556:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947192.032566:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032573:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032581:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xfa4a5ca6 (ffff94b1c93f9000) 00010000:00010000:2.0:1790947192.032583:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790947192.032586:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.032593:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df31e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xfa4a5ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947192.032717:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+39:18785:x1877943573973248:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 893us (1078us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790947192.032724:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1790947192.053637:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.053743:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573973376 00000100:00100000:1.0:1790947192.053754:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573973376 00000100:00100000:1.0:1790947192.053853:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:1.0:1790947192.053912:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+39:18785:x1877943573973376:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790947192.053935:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947192.053960:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df325 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1f4 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.054037:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df32c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.054052:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df32c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.054065:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df32c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.054958:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601400/0xe6f6b79c2d6df325 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1f4 expref: 41 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.054982:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601c00/0xe6f6b79c2d6df32c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1f4 expref: 40 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.054990:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:1.0:1790947192.054993:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790947192.054997:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7601c00, rc 0) 00000100:00100000:1.0:1790947192.055089:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+40:18785:x1877943573973376:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1190us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947192.055097:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1790947192.058663:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.058822:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573973632 00000100:00100000:3.0:1790947192.058832:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573973632 00000100:00100000:3.0:1790947192.059023:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:3.0:1790947192.059034:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+40:18785:x1877943573973632:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790947192.059116:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.059244:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.059257:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790947192.059423:0:22754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1790947192.059433:0:22754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688140573656ns, next at 689140571497ns, rc = 0 00000004:00010000:3.0:1790947192.059496:0:22754:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000158e3027 reply state 0000000091064f0b transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.059508:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.059515:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:3.0:1790947192.059517:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790947192.059520:0:22754:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790947192.059728:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+42:18785:x1877943573973632:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 687us (1064us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1790947192.059737:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:2.0:1790947192.065714:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.065803:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573973760 00000100:00100000:3.0:1790947192.065812:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573973760 00000100:00100000:3.0:1790947192.065915:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1790947192.065926:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+42:18785:x1877943573973760:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790947192.065950:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947192.065970:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f1fb expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.066038:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 43 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.066053:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 43 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.066070:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:3.0:1790947192.066073:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790947192.066089:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1c13cec00, rc 0) 00000100:00100000:3.0:1790947192.066137:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+43:18785:x1877943573973760:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 213us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.066143:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:0.0:1790947192.086135:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.086292:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573973888 00000100:00100000:1.0:1790947192.086303:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573973888 00000100:00100000:1.0:1790947192.086371:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1790947192.086381:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:570e5cec-6181-4423-9892-8b4e68369024+5:2404:x1877943573973888:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790947192.086679:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790947192.086716:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:570e5cec-6181-4423-9892-8b4e68369024+6:2404:x1877943573973888:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 335us (606us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1790947192.086753:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:0.0:1790947192.105330:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.107062:0:22755:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573974144 00000100:00100000:1.0:1790947192.107076:0:22755:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573974144 00000100:00100000:1.0:1790947192.107150:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1790947192.107172:0:22755:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+43:18785:x1877943573974144:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790947192.107413:0:22755:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+44:18785:x1877943573974144:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 252us (2092us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1790947192.107421:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1790947192.114027:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.114250:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573974400 00000100:00100000:3.0:1790947192.114264:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573974400 00000100:00100000:3.0:1790947192.114343:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:3.0:1790947192.114355:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+44:18785:x1877943573974400:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790947192.117202:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+44:18785:x1877943573974400:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 2830us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.117222:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:2.0:1790947192.126421:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.126568:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573974528 00000100:00100000:3.0:1790947192.126582:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573974528 00000100:00100000:3.0:1790947192.126664:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1790947192.126676:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+44:18785:x1877943573974528:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790947192.126704:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947192.126743:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df341 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f202 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.126982:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df348 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.127002:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df348 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.127027:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df348 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790947192.127112:0:22752:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790947192.127138:0:22752:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df348 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.127176:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df341 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f202 expref: 46 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.127200:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df348 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f202 expref: 45 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.127209:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:3.0:1790947192.127212:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790947192.127217:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46200, rc 0) 00000100:00100000:3.0:1790947192.128461:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+45:18785:x1877943573974528:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1774us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.128475:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:0.0:1790947192.135966:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.136231:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573974656 00000100:00100000:1.0:1790947192.136244:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573974656 00000100:00100000:1.0:1790947192.136322:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1790947192.136335:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+6:2403:x1877943573974656:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790947192.136370:0:24261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947192.136400:0:24261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f209 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790947192.136434:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfaf78, blocks: 0x0 00010000:00010000:1.0:1790947192.136459:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=688s v=(0 0) 00010000:00010000:1.0:1790947192.136464:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947192.136476:0:24261:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 7 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.136499:0:24261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 7 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.136535:0:24261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600a00, rc 0) 00000100:00100000:1.0:1790947192.136625:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+7:2403:x1877943573974656:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 292us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947192.136634:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1790947192.149969:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.150085:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573974912 00000100:00100000:0.0:1790947192.150099:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573974912 00000100:00100000:0.0:1790947192.150177:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:0.0:1790947192.150189:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1eee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+45:18785:x1877943573974912:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790947192.150337:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1eee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+45:18785:x1877943573974912:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 150us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947192.150346:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:3.0:1790947192.160372:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.160560:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975040 00000100:00100000:2.0:1790947192.160574:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975040 00000100:00100000:2.0:1790947192.160657:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:2.0:1790947192.160669:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+45:18785:x1877943573975040:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790947192.163391:0:22732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1790947192.163420:0:22732:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790947192.163490:0:22732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1790947192.163829:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.163845:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.163855:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.163904:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7601e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1790947192.163910:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.163928:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.163949:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:3.0:1790947192.163952:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790947192.163958:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.163965:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7601e00/0xe6f6b79c2d6df149 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947192.163994:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947192.164026:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594005632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790947192.164116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947192.164177:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594005632 00000100:00100000:3.0:1790947192.164187:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594005632 00000100:00100000:3.0:1790947192.164247:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947192.164257:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943594005632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790947192.164433:0:24260:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790947192.164437:0:24260:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790947192.164440:0:24260:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790947192.164443:0:24260:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790947192 -> 1790947192 00002000:00010000:3.0:1790947192.164446:0:24260:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790947192.164492:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877943594005632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (376us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1790947192.164500:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790947192.164523:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790947192.164560:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94b0c7f09180/2, rc 0, transno 12884901892 00000100:00100000:3.0:1790947192.164573:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594005632:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790947192.165089:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165101:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165108:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165112:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165116:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165123:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165137:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94b0c6680d00) 00010000:00010000:0.0:1790947192.165139:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.165143:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165149:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29200/0xe6f6b79c2d6df0cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165186:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165192:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165198:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165203:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1f6c29a00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165206:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165211:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165220:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:0.0:1790947192.165223:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.165225:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165231:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1f6c29a00/0xe6f6b79c2d6df0d2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165244:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165249:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165255:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165266:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165269:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165275:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165283:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94b1c93f9a00) 00010000:00010000:0.0:1790947192.165285:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.165288:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165293:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df1c0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165310:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165316:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165321:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165326:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb46600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165328:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165334:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165353:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947192.165355:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.165358:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165363:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46600/0xe6f6b79c2d6df245 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165376:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165384:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165390:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165395:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb47e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165398:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165403:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165421:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947192.165423:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.165426:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165431:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47e00/0xe6f6b79c2d6df268 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165456:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165462:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165469:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165474:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb46e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165477:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165484:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165491:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947192.165494:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.165496:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165502:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46e00/0xe6f6b79c2d6df2ae lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165514:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165521:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165527:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165539:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1c13cea00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.165542:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165548:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165557:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:0.0:1790947192.165559:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790947192.165563:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.165570:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cea00/0xe6f6b79c2d6df333 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947192.166151:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+14:18785:x1877943573975040:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 5475us (5786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.166164:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:2.0:1790947192.171792:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.171999:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975168 00000100:00100000:1.0:1790947192.172035:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975168 00000100:00100000:1.0:1790947192.172105:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1790947192.172116:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+7:2404:x1877943573975168:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790947192.172247:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+7:2404:x1877943573975168:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 132us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947192.172256:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:0.0:1790947192.175391:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.175501:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975424 00000100:00100000:1.0:1790947192.175515:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975424 00000100:00100000:1.0:1790947192.175598:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:1.0:1790947192.175610:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+14:18785:x1877943573975424:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790947192.175705:0:24232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947192.175747:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb46200/0xe6f6b79c2d6df348 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f202 expref: 14 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.175771:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:1.0:1790947192.175957:0:24232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790947192.175997:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df356 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.176027:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df356 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.176039:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df356 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790947192.176203:0:24232:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000054003173 reply state 00000000e1d23b18 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df356 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.176218:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7600600/0xe6f6b79c2d6df356 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.176225:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:1.0:1790947192.176228:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790947192.176230:0:24232:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790947192.176346:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+15:18785:x1877943573975424:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 737us (968us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1790947192.176355:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:3.0:1790947192.187229:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.187359:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975552 00000100:00100000:1.0:1790947192.187373:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975552 00000100:00100000:1.0:1790947192.187451:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:1.0:1790947192.187463:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:570e5cec-6181-4423-9892-8b4e68369024+7:18785:x1877943573975552:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790947192.187489:0:24260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790947192.187516:0:24260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f210 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.187582:0:24260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 8 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.187591:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947192.187596:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790947192.187603:0:24260:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.187649:0:24260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 8 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.187665:0:24260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 8 pid: 24261 timeout: 788 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947192.187682:0:24260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1eee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24260:1877943594005760:192.168.203.29@tcp:104: 00000100:00100000:1.0:1790947192.187813:0:24260:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c65690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790947192.190784:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.191102:0:22739:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975680 00000100:00100000:3.0:1790947192.191115:0:22739:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975680 00010000:00010000:3.0:1790947192.191171:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 9 pid: 24261 timeout: 788 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947192.191230:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1790947192.191241:0:22739:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+9:2404:x1877943573975680:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947192.191262:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947192.191290:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 9 pid: 24261 timeout: 788 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.191307:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 9 pid: 24261 timeout: 788 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.191339:0:22739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947192.191345:0:22739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947192.191354:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.191366:0:22739:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.191415:0:22739:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947192.191463:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22739:1877943594005888:192.168.203.29@tcp:105: 00000100:00100000:3.0:1790947192.191563:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6d84780 going to sleep for 11 seconds 00010000:00010000:1.0:1790947192.192951:0:24260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4e3b10/0xe6f6b79c2d6df34f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f209 expref: 9 pid: 24261 timeout: 788 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947192.192974:0:24260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1eee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24260:1877943594005760:192.168.203.29@tcp:104: 00010000:00010000:1.0:1790947192.193020:0:24260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.193058:0:24260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7600c00, rc 0) 00000100:00100000:1.0:1790947192.193115:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:570e5cec-6181-4423-9892-8b4e68369024+8:18785:x1877943573975552:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 5655us (5904us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947192.193125:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:2.0:1790947192.199553:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.200035:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c7f08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22739:1877943594005888:192.168.203.29@tcp:105: 00010000:00010000:3.0:1790947192.200066:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947192.200144:0:22739:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:570e5cec-6181-4423-9892-8b4e68369024+7:2404:x1877943573975680:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 8904us (9382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.200159:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1790947192.207114:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975808 00000100:00100000:1.0:1790947192.207134:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975808 00000100:00100000:0.0:1790947192.211454:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1790947192.211473:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+7:2404:x1877943573975808:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790947192.211707:0:24261:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790947192.211712:0:24261:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790947191 00002000:00010000:0.0:1790947192.211715:0:24261:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790947190 00002000:00010000:0.0:1790947192.211717:0:24261:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790947192 -> 1790947191 00002000:00010000:0.0:1790947192.211719:0:24261:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790947192.211812:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:570e5cec-6181-4423-9892-8b4e68369024+8:2404:x1877943573975808:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 343us (12274us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1790947192.211821:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1790947192.214784:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.214898:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573975936 00000100:00100000:0.0:1790947192.214912:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573975936 00000100:00100000:0.0:1790947192.214985:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1790947192.214996:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:570e5cec-6181-4423-9892-8b4e68369024+8:2405:x1877943573975936:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790947192.215064:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.215089:0:24665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.215100:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790947192.215105:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790947192.215111:0:24665:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.215171:0:24665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.215188:0:24665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 8 pid: 24260 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.215206:0:24665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24665:1877943594006016:192.168.203.29@tcp:104: 00000100:00100000:0.0:1790947192.215306:0:24665:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790947192.221708:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.221847:0:24665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24665:1877943594006016:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947192.221922:0:24665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947192.222537:0:22737:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976064 00000100:00100000:3.0:1790947192.222551:0:22737:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976064 00010000:00010000:2.0:1790947192.222653:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947192.222753:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1790947192.222765:0:22737:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:570e5cec-6181-4423-9892-8b4e68369024+9:2404:x1877943573976064:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790947192.222784:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790947192.222811:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.222827:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.222855:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000561d7710/0xe6f6b79c2d6df35d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f210 expref: 9 pid: 24260 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.222892:0:22737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790947192.222896:0:22737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790947192.222902:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.222911:0:22737:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223101:0:24665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223110:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223133:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223141:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223314:0:24665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223321:0:24665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:0.0:1790947192.223325:0:24665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223334:0:24665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223348:0:24665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.223366:0:24665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b126d6/0xe6f6b79c2d6df364 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.223463:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:570e5cec-6181-4423-9892-8b4e68369024+8:2405:x1877943573975936:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 8468us (8692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947192.223473:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00010000:00010000:2.0:1790947192.223545:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790947192.223568:0:22737:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:570e5cec-6181-4423-9892-8b4e68369024+7:2404:x1877943573976064:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 806us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.223577:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1790947192.231352:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.233342:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976320 00000100:00100000:3.0:1790947192.233360:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976320 00000100:00100000:3.0:1790947192.233457:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1790947192.233471:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+15:18785:x1877943573976320:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790947192.234076:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.234107:0:22752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.234121:0:22752:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.234250:0:22752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.234271:0:22752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 15 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.234289:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22752:1877943594006144:192.168.203.29@tcp:104: 00000100:00100000:0.0:1790947192.234416:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790947192.241375:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.241446:0:24286:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976448 00000100:00100000:3.0:1790947192.241458:0:24286:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976448 00010000:00010000:3.0:1790947192.241508:0:24286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947192.241571:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1790947192.241580:0:24286:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:570e5cec-6181-4423-9892-8b4e68369024+16:2404:x1877943573976448:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790947192.241596:0:24286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790947192.241602:0:24286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.241614:0:24286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.241636:0:24286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:3.0:1790947192.241640:0:24286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 16 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.241650:0:24286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.241665:0:24286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.241672:0:24286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.241690:0:24286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790947192.241768:0:24286:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:570e5cec-6181-4423-9892-8b4e68369024+16:2404:x1877943573976448:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 188us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.241775:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:0.0:1790947192.243053:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47400/0xe6f6b79c2d6df23e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1ae expref: 15 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.243089:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22752:1877943594006144:192.168.203.29@tcp:104: 00010000:00010000:0.0:1790947192.243121:0:22752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243133:0:22752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243140:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243473:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243491:0:22752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243500:0:22752:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243543:0:22752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.243561:0:22752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 15 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.243576:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22752:1877943594006272:192.168.203.29@tcp:104: 00000100:00100000:0.0:1790947192.243691:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1ef206600 going to sleep for 11 seconds 00000100:00100000:2.0:1790947192.251166:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.251287:0:22738:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976576 00000100:00100000:1.0:1790947192.251302:0:22738:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976576 00010000:00010000:1.0:1790947192.251357:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947192.251450:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:1.0:1790947192.251464:0:22738:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1d0683850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:570e5cec-6181-4423-9892-8b4e68369024+16:2404:x1877943573976576:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790947192.251485:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790947192.251495:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.251511:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.251518:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22752:1877943594006272:192.168.203.29@tcp:104: 00010000:00010000:1.0:1790947192.251740:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1c13cec00/0xe6f6b79c2d6df33a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1fb expref: 16 pid: 22752 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790947192.258376:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.258436:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.258457:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.258483:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.258511:0:22747:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976704 00000100:00100000:2.0:1790947192.258746:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976832 00000100:00100000:2.0:1790947192.258834:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976832 00000100:00100000:2.0:1790947192.258955:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977088 00000100:00100000:2.0:1790947192.258959:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977088 00000100:00100000:2.0:1790947192.258991:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:2.0:1790947192.259015:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+5:2403:x1877943573976832:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947192.259125:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+5:2403:x1877943573976832:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 124us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.259134:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:2.0:1790947192.259156:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1790947192.259162:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+6:2403:x1877943573977088:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947192.259196:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+6:2403:x1877943573977088:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 33us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.259203:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1790947192.259260:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.259339:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.259353:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977216 00000100:00100000:2.0:1790947192.259367:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977216 00000100:00100000:2.0:1790947192.259393:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:2.0:1790947192.259399:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+5:2403:x1877943573977216:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947192.259425:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d5d97ab-7494-4872-819e-977ae754088f+5:2403:x1877943573977216:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.259432:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:2.0:1790947192.259491:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1790947192.259630:0:22747:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976704 00000100:00100000:3.0:1790947192.259896:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 167 00000100:00100000:3.0:1790947192.259907:0:22747:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5aff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:2403:x1877943573976704:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1790947192.259942:0:22747:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5aff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bce661d0-1e50-4766-a156-91ae28874164+13:2403:x1877943573976704:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 38us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.259949:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 167 00000100:00080000:3.0:1790947192.259983:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790947192.259988:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790947192.259998:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573976960 00000100:00100000:3.0:1790947192.260002:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573976960 00000100:00100000:3.0:1790947192.260047:0:24259:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977472 00000100:00100000:3.0:1790947192.260050:0:24259:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977472 00000100:00100000:3.0:1790947192.260068:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1790947192.260074:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:570e5cec-6181-4423-9892-8b4e68369024+5:2403:x1877943573976960:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1790947192.260101:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:570e5cec-6181-4423-9892-8b4e68369024+5:2403:x1877943573976960:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.260107:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1790947192.260117:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1790947192.260123:0:24259:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d5d97ab-7494-4872-819e-977ae754088f+5:2403:x1877943573977472:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1790947192.260145:0:24259:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d5d97ab-7494-4872-819e-977ae754088f+5:2403:x1877943573977472:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 23us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.260151:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00080000:3.0:1790947192.260173:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790947192.260176:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790947192.260878:0:24260:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977344 00000100:00100000:2.0:1790947192.260888:0:24260:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977344 00000100:00100000:2.0:1790947192.260946:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1790947192.260956:0:24260:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d5d97ab-7494-4872-819e-977ae754088f+5:2403:x1877943573977344:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1790947192.261030:0:24260:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d5d97ab-7494-4872-819e-977ae754088f+5:2403:x1877943573977344:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 75us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.261036:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:1.0:1790947192.261179:0:22738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:0.0:1790947192.261182:0:22752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.261189:0:22738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.261218:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.261228:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.261262:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790947192.261268:0:22752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.261277:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947192.261305:0:22738:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1d0683850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:570e5cec-6181-4423-9892-8b4e68369024+15:2404:x1877943573976576:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 9843us (10154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947192.261316:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00080000:3.0:1790947192.261371:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1790947192.261421:0:22752:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1790947192.261571:0:22752:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1790947192.261619:0:22752:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1790947192.261716:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22752:1877943594006400:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790947192.261791:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947192.261835:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b0c660c480 going to sleep for 11 seconds 00000100:00100000:3.0:1790947192.266270:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594006400 00000100:00100000:3.0:1790947192.266293:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594006400 00000100:00100000:3.0:1790947192.266384:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790947192.266397:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22752:x1877943594006400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790947192.266572:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22752:x1877943594006400:12345-0@lo:1000:mdt00_000.0 Request processed in 178us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.266580:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790947192.266648:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22752:1877943594006400:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790947192.266990:0:22752:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1790947192.267106:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c583df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22752:1877943594006528:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790947192.267155:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947192.267190:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41180 going to sleep for 11 seconds 00000100:00100000:3.0:1790947192.267248:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594006528 00000100:00100000:3.0:1790947192.267255:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594006528 00000100:00100000:3.0:1790947192.267334:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790947192.267345:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22752:x1877943594006528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790947192.267473:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22752:x1877943594006528:12345-0@lo:1000:mdt00_000.0 Request processed in 130us (317us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1790947192.267481:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790947192.267513:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c583df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22752:1877943594006528:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790947192.267556:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267568:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267577:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267593:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947192.267599:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267609:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267627:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:2.0:1790947192.267630:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790947192.267636:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267642:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25e00/0xe6f6b79c2d6df372 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267682:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267689:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267695:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267699:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb47000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1790947192.267702:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267709:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267730:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:2.0:1790947192.267732:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790947192.267741:0:22752:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267753:0:22752:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267764:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.267821:0:22752:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24800/0xe6f6b79c2d6df2d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f1df expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790947192.267834:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c583ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22752:1877943594006656:192.168.203.29@tcp:105: 00000100:00100000:2.0:1790947192.267939:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff94b1f6f41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790947192.270248:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.270349:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c583ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22752:1877943594006656:192.168.203.29@tcp:105: 00010000:00010000:0.0:1790947192.270385:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270397:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47000/0xe6f6b79c2d6df2ca lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270441:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270458:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270472:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270484:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270491:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270498:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270504:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.270509:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270545:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270556:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947192.270558:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.270561:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270565:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df379 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270573:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270577:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270580:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270584:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ecb47600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.270586:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270589:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270593:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947192.270594:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790947192.270596:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.270606:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ecb47600/0xe6f6b79c2d6df36b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790947192.270771:0:22755:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977600 00000100:00100000:1.0:1790947192.270780:0:22755:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977600 00000100:00100000:1.0:1790947192.270851:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1790947192.270899:0:22755:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+19:18784:x1877943573977600:12345-192.168.203.29@tcp:49:bash.0 00000100:00100000:0.0:1790947192.271036:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:570e5cec-6181-4423-9892-8b4e68369024+19:18785:x1877943573976320:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 37567us (39892us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1790947192.271046:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000020:00080000:0.0:1790947192.271053:0:22752:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1790947192.271210:0:22755:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:570e5cec-6181-4423-9892-8b4e68369024+18:18784:x1877943573977600:12345-192.168.203.29@tcp:49:bash.0 Request processed in 314us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1790947192.271215:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000040:00080000:2.0:1790947192.271358:0:22787:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790947192.271364:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790947192.271383:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790947192.271389:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790947192.273695:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.273915:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977856 00000100:00100000:2.0:1790947192.273928:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977856 00000100:00100000:2.0:1790947192.273991:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1790947192.274002:0:22755:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1790947192.274026:0:22755:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1790947192.274381:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+18:18785:x1877943573977856:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790947192.274767:0:22756:0:(mdd_object.c:4180:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790947192.274831:0:22756:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1790947192.274928:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.274950:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.274964:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.274975:0:22756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.274983:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.274990:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.276370:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:2.0:1790947192.276479:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790947192.276497:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790947192.276508:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.276519:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b1ef222e00 already unused, calling callback (ffffffffc0ddfac0) 00010000:00010000:1.0:1790947192.276524:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.276536:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.276577:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff94b1f4128500) 00010000:00010000:1.0:1790947192.276580:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790947192.276587:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.276594:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222e00/0xe6f6b79c2d6df380 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790947192.276609:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947192.276612:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790947192.276614:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790947192.276622:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+20:18785:x1877943573977856:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 2245us (2938us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1790947192.276634:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000020:00080000:2.0:1790947192.276648:0:22756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790947192.276689:0:24665:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573977984 00000100:00100000:3.0:1790947192.276700:0:24665:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573977984 00000100:00100000:3.0:1790947192.276771:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:3.0:1790947192.276782:0:24665:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:570e5cec-6181-4423-9892-8b4e68369024+7:18784:x1877943573977984:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1790947192.276800:0:24665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790947192.276822:0:24665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000212e1437/0xe6f6b79c2d6df387 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f217 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790947192.276851:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6abfaf77, atime: 0x6abfaf76, ctime: 0x6abfaf77, blocks: 0x0 00010000:00010000:3.0:1790947192.276902:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1790947192.276914:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790947192.276926:0:24665:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000212e1437/0xe6f6b79c2d6df387 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f217 expref: 8 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.276945:0:24665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000212e1437/0xe6f6b79c2d6df387 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f217 expref: 8 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790947192.276959:0:24665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ecb46200, rc 0) 00000100:00100000:3.0:1790947192.278723:0:24665:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:570e5cec-6181-4423-9892-8b4e68369024+8:18784:x1877943573977984:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1173us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.278740:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1790947192.280985:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1790947192.281176:0:22753:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573978112 00000100:00100000:2.0:1790947192.281189:0:22753:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573978112 00000100:00100000:2.0:1790947192.281257:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:2.0:1790947192.281269:0:22753:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+20:18784:x1877943573978112:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1790947192.281305:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790947192.281331:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df38e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f21e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.281456:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df395 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.281469:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df395 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.281478:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df395 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.281609:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef223e00/0xe6f6b79c2d6df38e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f21e expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.281626:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b1ef222c00/0xe6f6b79c2d6df395 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f21e expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790947192.281633:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:2.0:1790947192.281636:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790947192.281639:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b1ef222c00, rc 0) 00000100:00100000:2.0:1790947192.281723:0:22753:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:570e5cec-6181-4423-9892-8b4e68369024+21:18784:x1877943573978112:12345-192.168.203.29@tcp:101:bash.0 Request processed in 455us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947192.281739:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:2.0:1790947192.289932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.290402:0:22756:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573978368 00000100:00100000:0.0:1790947192.290415:0:22756:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573978368 00000100:00100000:0.0:1790947192.290491:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1790947192.290503:0:22756:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+21:18784:x1877943573978368:12345-192.168.203.29@tcp:35:bash.0 00000001:00080000:0.0:1790947192.291239:0:22756:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1790947192.291349:0:22756:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1790947192.292055:0:22756:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:570e5cec-6181-4423-9892-8b4e68369024+24:18784:x1877943573978368:12345-192.168.203.29@tcp:35:bash.0 Request processed in 1548us (2132us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1790947192.292068:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000020:00080000:0.0:1790947192.292075:0:22756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790947192.411296:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.417210:0:22754:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573978624 00000100:00100000:0.0:1790947192.417232:0:22754:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573978624 00000100:00100000:0.0:1790947192.417331:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:0.0:1790947192.417347:0:22754:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c5f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+24:18795:x1877943573978624:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1790947192.417673:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790947192.417703:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa62e611e89f0f225 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790947192.418100:0:22754:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790947192.418306:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df39c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f225 expref: 26 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.418324:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94b1f4128d00) 00010000:00010000:0.0:1790947192.418327:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790947192.418332:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0xa62e611e89f0f225 expref: 26 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.418350:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94b0c7e24200, rc 0) 00000100:00100000:0.0:1790947192.418685:0:22754:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c5f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:570e5cec-6181-4423-9892-8b4e68369024+25:18795:x1877943573978624:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1341us (7403us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1790947192.418694:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:2.0:1790947192.424364:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1790947192.424422:0:24232:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573978752 00000100:00100000:0.0:1790947192.424436:0:24232:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573978752 00000100:00100000:0.0:1790947192.424520:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:0.0:1790947192.424533:0:24232:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+25:18795:x1877943573978752:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:0.0:1790947192.425124:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425146:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425165:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425182:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425270:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425278:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425403:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425413:0:24232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425420:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790947192.425475:0:24232:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425489:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425496:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425504:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425511:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.425516:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425525:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425546:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94b0c6680f00) 00010000:00010000:0.0:1790947192.425549:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.425555:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425562:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24200/0xe6f6b79c2d6df3aa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425578:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425584:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425590:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425596:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e25600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.425599:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425604:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425611:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94b1f6bebc00) 00010000:00010000:0.0:1790947192.425613:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.425616:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425622:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e25600/0xe6f6b79c2d6df3b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425653:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425660:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425666:0:24232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425672:0:24232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94b0c7e24600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1790947192.425674:0:24232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425681:0:24232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425690:0:24232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff94b1c93f9c00) 00010000:00010000:0.0:1790947192.425692:0:24232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790947192.425696:0:24232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790947192.425701:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94b0c7e24600/0xe6f6b79c2d6df3b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790947192.425818:0:24232:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:570e5cec-6181-4423-9892-8b4e68369024+25:18795:x1877943573978752:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1285us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947192.425829:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:2.0:1790947192.432976:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1790947192.434527:0:25803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943573979008 00000100:00100000:1.0:1790947192.434542:0:25803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943573979008 00000100:00100000:1.0:1790947192.434644:0:25803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1790947192.434656:0:25803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:570e5cec-6181-4423-9892-8b4e68369024+25:18795:x1877943573979008:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1790947192.435285:0:25803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:570e5cec-6181-4423-9892-8b4e68369024+26:18795:x1877943573979008:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 627us (2319us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1790947192.435411:0:25803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1790947192.526458:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790947192.526491:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943594006784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790947192.526616:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947192.526884:0:24262:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594006784 00000100:00100000:3.0:1790947192.526894:0:24262:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594006784 00000100:00100000:3.0:1790947192.526974:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790947192.526985:0:24262:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943594006784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790947192.527137:0:24262:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790947192.527257:0:24262:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877943594006784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 273us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947192.527267:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1790947192.527376:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790947192.529443:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1877943594006784:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790947192.654831:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947193.552294:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790947193.552318:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943594006912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790947193.552382:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947193.552432:0:22757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594006912 00000100:00100000:3.0:1790947193.552440:0:22757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594006912 00000100:00100000:3.0:1790947193.552488:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790947193.552509:0:22757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c5f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943594006912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790947193.552541:0:22757:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790947193.552585:0:22757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c5f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943594006912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947193.552592:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790947193.552635:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943594006912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790947193.552766:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947193.552776:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943594007040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790947193.552812:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947193.552849:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007040 00000100:00100000:0.0:1790947193.552852:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007040 00000100:00100000:0.0:1790947193.552909:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790947193.552916:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943594007040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790947193.552929:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790947193.552959:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1877943594007040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947193.552965:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1790947193.552980:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790947193.553012:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1877943594007040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790947193.554368:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790947193.554384:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594007168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790947193.554436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790947193.554532:0:22758:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007168 00000100:00100000:2.0:1790947193.554539:0:22758:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007168 00000100:00100000:2.0:1790947193.554588:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790947193.554598:0:22758:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c5f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594007168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790947193.554630:0:22758:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1790947193.554688:0:22758:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c5f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594007168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947193.554695:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790947193.554785:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594007168:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790947193.678015:0:24994:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790947194.014221:0:25840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:2.0:1790947194.318076:0:22787:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790947194.318085:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790947194.318107:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790947194.318117:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1790947194.702163:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790947195.599185:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594007296:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599257:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599293:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943594007808:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599339:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943594008320:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599359:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599372:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1877943594008832:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599405:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599430:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790947195.599436:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943594007424:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599477:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943594007936:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599511:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1877943594008448:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599570:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594007552:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599594:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599613:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594008064:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599646:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1877943594008576:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599678:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790947195.599683:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594007680:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599704:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599729:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594008192:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599763:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1c5f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1877943594008704:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.599782:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.599808:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007808 00000100:00100000:3.0:1790947195.599815:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007808 00000100:00100000:3.0:1790947195.599849:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008320 00000100:00100000:3.0:1790947195.599851:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008320 00000100:00100000:3.0:1790947195.599890:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008832 00000100:00100000:3.0:1790947195.599893:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008832 00000100:00100000:3.0:1790947195.599912:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008448 00000100:00100000:3.0:1790947195.599915:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008448 00000100:00100000:3.0:1790947195.599926:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008576 00000100:00100000:3.0:1790947195.599928:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008576 00000100:00100000:3.0:1790947195.599939:0:22752:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008704 00000100:00100000:3.0:1790947195.599941:0:22752:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008704 00000100:00100000:3.0:1790947195.599955:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790947195.599963:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c5f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943594007808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600038:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c5f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877943594007808:12345-0@lo:400:kworker.0 Request processed in 75us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600046:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790947195.600066:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790947195.600071:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1c5f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877943594008320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600099:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1c5f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877943594008320:12345-0@lo:400:kworker.0 Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600104:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790947195.600115:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790947195.600121:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877943594008832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600148:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877943594008832:12345-0@lo:400:kworker.0 Request processed in 27us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600154:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790947195.600166:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790947195.600171:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877943594008448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600196:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877943594008448:12345-0@lo:400:kworker.0 Request processed in 25us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600201:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790947195.600213:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790947195.600219:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877943594008576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600249:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877943594008576:12345-0@lo:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600255:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790947195.600266:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790947195.600272:0:22752:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877943594008704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600308:0:22752:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877943594008704:12345-0@lo:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600314:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790947195.600334:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007424 00000100:00100000:3.0:1790947195.600338:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007424 00000100:00100000:3.0:1790947195.600360:0:23493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007936 00000100:00100000:3.0:1790947195.600362:0:23493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007936 00000100:00100000:3.0:1790947195.600374:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790947195.600379:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943594007424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600411:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877943594007424:12345-0@lo:400:kworker.0 Request processed in 32us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600416:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790947195.600427:0:23493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790947195.600433:0:23493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943594007936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600458:0:23493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877943594007936:12345-0@lo:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600463:0:23493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790947195.600483:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007552 00000100:00100000:3.0:1790947195.600487:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007552 00000100:00100000:3.0:1790947195.600505:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008064 00000100:00100000:3.0:1790947195.600508:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008064 00000100:00100000:3.0:1790947195.600517:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007680 00000100:00100000:3.0:1790947195.600519:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007680 00000100:00100000:3.0:1790947195.600528:0:24261:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008192 00000100:00100000:3.0:1790947195.600530:0:24261:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008192 00000100:00100000:3.0:1790947195.600540:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790947195.600546:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943594007552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600575:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877943594007552:12345-0@lo:400:kworker.0 Request processed in 29us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600588:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790947195.600600:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790947195.600605:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594008064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600635:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594008064:12345-0@lo:400:kworker.0 Request processed in 30us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600640:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790947195.600650:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790947195.600655:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1877943594007680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600680:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1877943594007680:12345-0@lo:400:kworker.0 Request processed in 26us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600686:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790947195.600696:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947195.600701:0:24261:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600724:0:24261:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877943594008192:12345-0@lo:400:kworker.0 Request processed in 23us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790947195.600729:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790947195.600777:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594007680:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600787:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594008192:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600796:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1877943594008704:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600805:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1877943594007552:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600813:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1877943594008064:0@lo:400:kworker.0 00010000:00080000:3.0:1790947195.600823:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1c5f04a80 x1877943594008576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947195.600841:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1877943594008576:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600902:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1877943594007424:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600911:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1877943594007936:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600920:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1877943594008448:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600927:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877943594007808:0@lo:400:kworker.0 00000100:00100000:3.0:1790947195.600936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877943594008320:0@lo:400:kworker.0 00010000:00080000:3.0:1790947195.600944:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94b1c5f07100 x1877943594008832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790947211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790947195.600952:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1877943594008832:0@lo:400:kworker.0 00000100:00100000:0.0:1790947195.601236:0:22746:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594007296 00000100:00100000:0.0:1790947195.601241:0:22746:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594007296 00000100:00100000:0.0:1790947195.601273:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790947195.601280:0:22746:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c5afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943594007296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790947195.601320:0:22746:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c5afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e22e84b-45e4-41c3-ac10-e0c57bc0d735+24:3639:x1877943594007296:12345-0@lo:400:kworker.0 Request processed in 40us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947195.601325:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1790947195.601359:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790947195.601363:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790947195.601366:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790947195.601369:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790947195.601378:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790947195.601388:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943594009088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790947195.601417:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790947195.601445:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594009088 00000100:00100000:0.0:1790947195.601455:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594009088 00000100:00100000:0.0:1790947195.601480:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790947195.601487:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b1f707ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943594009088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790947195.601508:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790947195.601545:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b1f707ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1877943594009088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790947195.601550:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790947195.601585:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1f707d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1877943594009088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790947195.605119:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94b0c74dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943594008960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790947195.605199:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790947195.605284:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b1c5f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e22e84b-45e4-41c3-ac10-e0c57bc0d735:3639:1877943594007296:0@lo:400:kworker.0 00000100:00100000:2.0:1790947195.607015:0:24263:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943594008960 00000100:00100000:2.0:1790947195.607029:0:24263:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943594008960 00000100:00100000:2.0:1790947195.607085:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790947195.607094:0:24263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff94b0c10a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877943594008960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790947195.607117:0:24263:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790947195.607187:0:24263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff94b0c10a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877943594008960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1790947195.607193:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790947195.607245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94b0c74dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1877943594008960:0@lo:13:osp-pre-1-0.0 Debug log: 14503 lines, 14503 kept, 0 dropped, 0 bad.