00010000:00010000:3.0F:1789448094.140881:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1789448095.168202:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448095.417193:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859255168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448095.417259:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448095.417328:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859255296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789448095.417367:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448095.417425:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255168 00000100:00100000:3.0:1789448095.417432:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255168 00000100:00100000:3.0:1789448095.417487:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255296 00000100:00100000:3.0:1789448095.417490:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255296 00000100:00100000:3.0:1789448095.417506:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789448095.417514:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c839f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859255168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789448095.417544:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789448095.417768:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c839f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859255168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 254us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448095.417776:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789448095.417794:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789448095.417802:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c839dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859255296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789448095.417818:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789448095.417852:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c839dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859255296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448095.417858:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789448095.417900:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859255168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448095.417941:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859255296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789448095.424048:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859255424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789448095.424113:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1789448095.424215:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255424 00000100:00100000:1.0:1789448095.424231:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255424 00000100:00100000:1.0:1789448095.424294:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789448095.424303:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c839c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859255424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789448095.424330:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789448095.424380:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c839c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859255424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448095.424387:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789448095.424481:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859255424:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789448095.424671:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789448095.931397:0:19506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1789448095.931416:0:19506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1789448095.943729:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:0.0:1789448095.943752:0:17166:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9517e74cd780 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1789448095.943757:0:17166:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9516c1ac5100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9517e74cd900 00000020:00080000:0.0:1789448095.943761:0:17166:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9516c1ac5500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9517fb937200 00010000:00010000:1.0:1789448095.943822:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448095.943835:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448095.943843:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448095.943849:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75fe00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448095.943854:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448095.943862:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448095.943879:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9517f27b6f00) 00010000:00010000:1.0:1789448095.943881:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448095.943886:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448095.943892:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75fe00/0x6522da1199ce4425 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789448095.943944:0:17225:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1789448095.944009:0:17225:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789448096.185566:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448096.332301:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332339:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332358:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332380:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332399:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332415:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332433:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332455:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332661:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448096.332694:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849753728 00000100:00100000:1.0:1789448096.332703:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849753728 00000100:00100000:1.0:1789448096.332749:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 169 00000100:00100000:1.0:1789448096.332758:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f93f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+13:2390:x1876371849753728:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448096.332820:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f93f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+13:2390:x1876371849753728:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 60us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.332828:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 169 00000100:00100000:1.0:1789448096.332862:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849753984 00000100:00100000:1.0:1789448096.332866:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849753984 00000100:00100000:1.0:1789448096.332897:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849753856 00000100:00100000:1.0:1789448096.332901:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849753856 00000100:00100000:1.0:1789448096.332912:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754368 00000100:00100000:1.0:1789448096.332914:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754368 00000100:00100000:1.0:1789448096.332924:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754496 00000100:00100000:1.0:1789448096.332926:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754496 00000100:00100000:1.0:1789448096.332954:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 66 00000100:00100000:1.0:1789448096.332960:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:2390:x1876371849753984:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448096.332991:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:2390:x1876371849753984:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.332997:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 66 00000100:00100000:1.0:1789448096.333010:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 67 00000100:00100000:1.0:1789448096.333016:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+12:2390:x1876371849753856:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448096.333037:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+12:2390:x1876371849753856:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 22us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.333043:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 67 00000100:00100000:1.0:1789448096.333056:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 68 00000100:00100000:1.0:1789448096.333062:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60c24871-0b2b-4850-b97c-73ceca98f51b+6:2389:x1876371849754368:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448096.334693:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 69 00000100:00100000:0.0:1789448096.334710:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2390:x1876371849754496:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448096.334768:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2390:x1876371849754496:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 64us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.334775:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 69 00000100:00100000:0.0:1789448096.334810:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754240 00000100:00100000:0.0:1789448096.334816:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754240 00000100:00100000:0.0:1789448096.334843:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754112 00000100:00100000:0.0:1789448096.334847:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754112 00000100:00100000:0.0:1789448096.334858:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754624 00000100:00100000:0.0:1789448096.334860:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754624 00000100:00100000:0.0:1789448096.334870:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754752 00000100:00100000:0.0:1789448096.334872:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754752 00000100:00100000:0.0:1789448096.334884:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 31 00000100:00100000:0.0:1789448096.334890:0:19002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+6:2389:x1876371849754240:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448096.334916:0:19002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+6:2389:x1876371849754240:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 26us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.334921:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 31 00000100:00100000:0.0:1789448096.334934:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 35 00000100:00100000:0.0:1789448096.334940:0:19002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:2388:x1876371849754112:12345-192.168.206.38@tcp:9:kworker.0 00000020:00000080:0.0:1789448096.334956:0:19002:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce40dd 00000100:00080000:0.0:1789448096.334970:0:19002:0:(import.c:65:import_set_state_nolock()) ffff9517fb940000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789448096.335022:0:19002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789448096.335222:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60c24871-0b2b-4850-b97c-73ceca98f51b+6:2389:x1876371849754368:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 2158us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.335230:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 68 00000100:00100000:1.0:1789448096.335258:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 36 00000100:00100000:1.0:1789448096.335266:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2388:x1876371849754624:12345-192.168.206.38@tcp:9:kworker.0 00000020:00000080:1.0:1789448096.335282:0:18694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce411c 00000100:00080000:1.0:1789448096.335288:0:18694:0:(import.c:65:import_set_state_nolock()) ffff9517fb941800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789448096.335314:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789448096.335386:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60c24871-0b2b-4850-b97c-73ceca98f51b+2:2388:x1876371849754624:12345-192.168.206.38@tcp:9:kworker.0 Request processed in 121us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.335394:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 36 00000100:00100000:1.0:1789448096.335406:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 37 00000100:00100000:1.0:1789448096.335420:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2388:x1876371849754752:12345-192.168.206.38@tcp:9:kworker.0 00000020:00000080:1.0:1789448096.335430:0:18694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce4123 00000100:00080000:1.0:1789448096.335437:0:18694:0:(import.c:65:import_set_state_nolock()) ffff9516c6431000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789448096.335473:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1789448096.335918:0:19002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+2:2388:x1876371849754112:12345-192.168.206.38@tcp:9:kworker.0 Request processed in 976us (3516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.335926:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 35 00010000:00010000:0.0:1789448096.335949:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448096.337309:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60c24871-0b2b-4850-b97c-73ceca98f51b+2:2388:x1876371849754752:12345-192.168.206.38@tcp:9:kworker.0 Request processed in 1885us (4643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.337320:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 37 00000100:00080000:1.0:1789448096.337510:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448096.337514:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789448096.337517:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448096.337520:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789448096.339337:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448096.339896:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448096.438760:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c839d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859255552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448096.438828:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448096.438902:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255552 00000100:00100000:3.0:1789448096.438910:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255552 00000100:00100000:3.0:1789448096.439834:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448096.439845:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859255552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448096.439872:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789448096.443048:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859255808:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443141:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448096.443187:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859256320:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443212:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448096.443231:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859256832:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443252:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448096.443276:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789448096.443282:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859255936:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443301:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448096.443318:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859256448:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443337:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448096.443354:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859256960:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443373:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448096.443412:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255808 00000100:00100000:1.0:1789448096.443429:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255808 00000100:00100000:1.0:1789448096.443484:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789448096.443492:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f93f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3634:x1876371859255808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443539:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f93f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3634:x1876371859255808:12345-0@lo:400:kworker.0 Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.443546:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789448096.443583:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256832 00000100:00100000:1.0:1789448096.443587:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256832 00000100:00100000:1.0:1789448096.443613:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256960 00000100:00100000:1.0:1789448096.443615:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256960 00000100:00100000:1.0:1789448096.443635:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789448096.443641:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859256832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443674:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859256832:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.443680:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789448096.443693:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789448096.443699:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859256960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443726:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859256960:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.443733:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789448096.443752:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256448 00000100:00100000:1.0:1789448096.443755:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256448 00000100:00100000:1.0:1789448096.443777:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448096.443783:0:19002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859256448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443813:0:19002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859256448:12345-0@lo:400:kworker.0 Request processed in 31us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.443819:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448096.443866:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859256448:0@lo:400:kworker.0 00010000:00080000:1.0:1789448096.443880:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7452300 x1876371859256960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448096.443889:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859256960:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443897:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859255808:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.443905:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859256832:0@lo:400:kworker.0 00000100:00100000:2.0F:1789448096.449602:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c826d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859255680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789448096.449686:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448096.449724:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859256192:0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.449747:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448096.449764:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859256704:0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.449784:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448096.449798:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859257216:0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.449814:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448096.449834:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789448096.449841:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859256064:0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.449863:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448096.449878:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859256576:0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.449895:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448096.449909:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859257088:0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.449927:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789448096.449956:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789448096.449974:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448096.449977:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448096.450003:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256320 00000100:00100000:2.0:1789448096.450011:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256320 00000100:00100000:2.0:1789448096.450049:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255936 00000100:00100000:2.0:1789448096.450052:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255936 00000100:00100000:2.0:1789448096.450069:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789448096.450076:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859256320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.450139:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859256320:12345-0@lo:400:kworker.0 Request processed in 51us (6913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448096.450146:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789448096.450171:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789448096.450178:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859255936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448096.450210:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859255936:12345-0@lo:400:kworker.0 Request processed in 34us (6908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448096.450216:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789448096.450287:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256192 00000100:00100000:0.0:1789448096.450291:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256192 00000100:00100000:0.0:1789448096.450312:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256704 00000100:00100000:0.0:1789448096.450315:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256704 00000100:00100000:0.0:1789448096.450325:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257216 00000100:00100000:0.0:1789448096.450327:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257216 00000100:00100000:0.0:1789448096.450350:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257088 00000100:00100000:0.0:1789448096.450353:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257088 00000100:00100000:0.0:1789448096.450367:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789448096.450374:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859256192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448096.450413:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c826f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859256192:12345-0@lo:400:kworker.0 Request processed in 39us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.450419:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789448096.450433:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789448096.450438:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c897ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859256704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448096.450479:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c897ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859256704:12345-0@lo:400:kworker.0 Request processed in 41us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.450485:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789448096.450497:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789448096.450502:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859257216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448096.450528:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859257216:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.450544:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789448096.450556:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789448096.450562:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1876371859257088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448096.450591:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1876371859257088:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448096.450595:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789448096.450609:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448096.450612:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789448096.450643:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859257088:0@lo:400:kworker.0 00000100:00100000:0.0:1789448096.450654:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859256192:0@lo:400:kworker.0 00000100:00100000:0.0:1789448096.450662:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859256704:0@lo:400:kworker.0 00010000:00080000:0.0:1789448096.450674:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7453800 x1876371859257216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448096.450684:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859257216:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.453340:0:20323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859255680 00000100:00100000:1.0:1789448096.453353:0:20323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859255680 00000100:00100000:1.0:1789448096.453412:0:20323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789448096.453421:0:20323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c826dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859255680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789448096.453443:0:20323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789448096.453534:0:20323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c826dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859255680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.453541:0:20323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789448096.453583:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256064 00000100:00100000:1.0:1789448096.453587:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256064 00000100:00100000:1.0:1789448096.453611:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859256576 00000100:00100000:1.0:1789448096.453614:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859256576 00000100:00100000:1.0:1789448096.453632:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789448096.453638:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859256064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.453674:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859256064:12345-0@lo:400:kworker.0 Request processed in 36us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.453679:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789448096.453692:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448096.453700:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859256576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.453743:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859256576:12345-0@lo:400:kworker.0 Request processed in 44us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448096.453749:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789448096.453811:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859255936:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.453825:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859256320:0@lo:400:kworker.0 00000100:00080000:1.0:1789448096.453850:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448096.453853:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448096.453874:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859256064:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.453885:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859256576:0@lo:400:kworker.0 00000100:00100000:1.0:1789448096.453898:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c826d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859255680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789448096.454431:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859255552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14586us (15601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448096.454439:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789448096.454605:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1789448096.454611:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9517e7410e00, transno 8589934596 00000004:00080000:2.0:1789448096.454628:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1789448096.454648:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c839d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859255552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789448097.207287:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448097.462247:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448097.462268:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859257344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448097.462330:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448097.462377:0:20323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257344 00000100:00100000:1.0:1789448097.462384:0:20323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257344 00000100:00100000:1.0:1789448097.462426:0:20323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448097.462435:0:20323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859257344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789448097.462483:0:20323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789448097.462527:0:20323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859257344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448097.462535:0:20323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448097.462586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859257344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448097.605754:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448097.608284:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849754880 00000100:00100000:0.0:1789448097.608297:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849754880 00000100:00100000:0.0:1789448097.608410:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 74 00000100:00100000:0.0:1789448097.608419:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+12:15578:x1876371849754880:12345-192.168.206.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789448097.608546:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+12:15578:x1876371849754880:12345-192.168.206.38@tcp:60:lhsmtool_posix.0 Request processed in 128us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448097.608553:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 74 00000100:00100000:2.0:1789448097.617046:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448097.631631:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755008 00000100:00100000:1.0:1789448097.631664:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755008 00000100:00100000:1.0:1789448097.631727:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 75 00000100:00100000:1.0:1789448097.631737:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:15578:x1876371849755008:12345-192.168.206.38@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789448097.631832:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:15578:x1876371849755008:12345-192.168.206.38@tcp:60:lhsmtool_posix.0 Request processed in 96us (14793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448097.631839:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 75 00000100:00100000:1.0:1789448097.638412:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448097.639026:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755264 00000100:00100000:0.0:1789448097.639036:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755264 00000100:00100000:0.0:1789448097.639109:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 16 00000100:00100000:0.0:1789448097.639126:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517d1c51c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+12:15578:x1876371849755264:12345-192.168.206.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789448097.639342:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517d1c51c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+13:15578:x1876371849755264:12345-192.168.206.38@tcp:35:lhsmtool_posix.0 Request processed in 224us (938us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789448097.639351:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 16 00010000:00010000:1.0:1789448098.229648:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789448098.869668:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789448098.869678:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789448098.869697:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789448098.869705:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789448099.262227:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448100.287228:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448100.423400:0:20560:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:54:58 (1789448098) 00000100:00100000:2.0:1789448100.544640:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448100.544661:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859257472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789448100.544723:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448100.544779:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257472 00000100:00100000:2.0:1789448100.544786:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257472 00000100:00100000:2.0:1789448100.544826:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789448100.544834:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859257472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789448100.544865:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789448100.544922:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859257472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448100.544930:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789448100.544974:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859257472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789448100.545189:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448100.545200:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859257600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789448100.545230:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448100.545373:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257600 00000100:00100000:3.0:1789448100.545379:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257600 00000100:00100000:3.0:1789448100.545416:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789448100.545433:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859257600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789448100.545453:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789448100.545534:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859257600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448100.545540:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789448100.545589:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859257600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448100.547153:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448100.547172:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859257728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789448100.547233:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448100.547447:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257728 00000100:00100000:0.0:1789448100.547455:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257728 00000100:00100000:0.0:1789448100.547532:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789448100.547542:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859257728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789448100.547566:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789448100.547611:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859257728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448100.547618:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789448100.547663:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859257728:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789448100.547737:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789448101.312395:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448101.444756:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448101.444795:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448101.444821:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448101.444848:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448101.444866:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448101.444885:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448101.444918:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755520 00000100:00100000:1.0:1789448101.444926:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755520 00000100:00100000:1.0:1789448101.444975:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849756032 00000100:00100000:1.0:1789448101.444978:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849756032 00000100:00100000:1.0:1789448101.444990:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755648 00000100:00100000:1.0:1789448101.444993:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755648 00000100:00100000:1.0:1789448101.445003:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755904 00000100:00100000:1.0:1789448101.445006:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755904 00000100:00100000:1.0:1789448101.445020:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 76 00000100:00100000:1.0:1789448101.445029:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+13:2392:x1876371849755520:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448101.445120:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+13:2392:x1876371849755520:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 73us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.445142:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 76 00000100:00100000:1.0:1789448101.445164:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 77 00000100:00100000:1.0:1789448101.445170:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2392:x1876371849756032:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448101.445198:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2392:x1876371849756032:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.445204:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 77 00000100:00100000:1.0:1789448101.445216:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 78 00000100:00100000:1.0:1789448101.445222:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:2392:x1876371849755648:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448101.445244:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:2392:x1876371849755648:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 22us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.445250:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 78 00000100:00100000:1.0:1789448101.445277:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 79 00000100:00100000:1.0:1789448101.445284:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+6:2392:x1876371849755904:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448101.445306:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+6:2392:x1876371849755904:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.445311:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 79 00000100:00100000:1.0:1789448101.445329:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755392 00000100:00100000:1.0:1789448101.445332:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755392 00000100:00100000:1.0:1789448101.445355:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 171 00000100:00100000:1.0:1789448101.445360:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f93fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+13:2392:x1876371849755392:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448101.445382:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f93fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+13:2392:x1876371849755392:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 21us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.445387:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 171 00000100:00080000:1.0:1789448101.445421:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789448101.445424:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448101.445676:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849755776 00000100:00100000:0.0:1789448101.445680:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849755776 00000100:00100000:0.0:1789448101.445724:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 35 00000100:00100000:0.0:1789448101.445731:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+6:2392:x1876371849755776:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448101.445763:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+6:2392:x1876371849755776:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 34us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448101.445769:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 35 00000100:00080000:1.0:1789448101.452278:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448101.558926:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859257984:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.558984:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559043:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859258496:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559080:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3635:1876371859259008:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559218:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448101.559218:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257984 00000100:00100000:0.0:1789448101.559227:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257984 00000100:00100000:1.0:1789448101.559260:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789448101.559267:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:502f2cd2-eb84-4c43-be93-396c392bd72c:3635:1876371859257856:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559296:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559319:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876371859258368:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559357:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859258880:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559374:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559389:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3635:1876371859259392:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559406:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559429:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859258112:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559450:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559485:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c826d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859258624:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559508:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559531:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859259136:0@lo:400:kworker.0 00000100:00100000:0.0:1789448101.559538:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258496 00000100:00100000:0.0:1789448101.559543:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258496 00000100:00100000:1.0:1789448101.559559:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448101.559563:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448101.559575:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859259520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789448101.559576:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789448101.559576:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789448101.559585:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859257984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559597:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859258240:0@lo:400:kworker.0 00000100:00100000:2.0:1789448101.559609:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.559641:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448101.559646:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859257984:12345-0@lo:400:kworker.0 Request processed in 60us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448101.559654:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789448101.559659:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259520 00000100:00100000:2.0:1789448101.559662:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259520 00000100:00100000:1.0:1789448101.559673:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859258752:0@lo:400:kworker.0 00000100:00100000:0.0:1789448101.559673:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789448101.559683:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859258496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448101.559698:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789448101.559707:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859259520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789448101.559708:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448101.559717:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859258496:12345-0@lo:400:kworker.0 Request processed in 35us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448101.559723:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00000024:2.0:1789448101.559728:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789448101.559737:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859259264:0@lo:400:kworker.0 00000100:00100000:0.0:1789448101.559755:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259008 00000100:00100000:0.0:1789448101.559759:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259008 00000100:00100000:2.0:1789448101.559768:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859259520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.559773:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448101.559781:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789448101.559781:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258368 00000100:00100000:0.0:1789448101.559784:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258368 00000100:00100000:0.0:1789448101.559797:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258880 00000100:00100000:1.0:1789448101.559799:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859259648:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789448101.559800:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789448101.559800:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258880 00000100:00080000:2.0:1789448101.559805:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448101.559815:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259392 00000100:00100000:0.0:1789448101.559817:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259392 00000100:00100000:0.0:1789448101.559834:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259136 00000100:00100000:0.0:1789448101.559837:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259136 00000100:00100000:2.0:1789448101.559838:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859259520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789448101.559846:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259264 00000100:00100000:0.0:1789448101.559848:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259264 00000100:00080000:2.0:1789448101.559854:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789448101.559856:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789448101.559861:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789448101.559867:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876371859259008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.559975:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448101.560014:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789448101.560022:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876371859258368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560050:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876371859258368:12345-0@lo:400:kworker.0 Request processed in 31us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560056:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789448101.560069:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789448101.560074:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859258880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560095:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859258880:12345-0@lo:400:kworker.0 Request processed in 22us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560111:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789448101.560124:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789448101.560130:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876371859259392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560158:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876371859259392:12345-0@lo:400:kworker.0 Request processed in 28us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560163:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789448101.560171:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789448101.560176:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859259136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560213:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859259136:12345-0@lo:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560219:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789448101.560230:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789448101.560521:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859259264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560553:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859259264:12345-0@lo:400:kworker.0 Request processed in 37us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560560:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789448101.560579:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859257856 00000100:00100000:1.0:1789448101.560584:0:17181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859257856 00000100:00100000:1.0:1789448101.560609:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789448101.560616:0:17181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f816bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3635:x1876371859257856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560807:0:17181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f816bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3635:x1876371859257856:12345-0@lo:400:kworker.0 Request processed in 191us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560814:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789448101.560853:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258112 00000100:00100000:1.0:1789448101.560857:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258112 00000100:00100000:1.0:1789448101.560882:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258624 00000100:00100000:1.0:1789448101.560885:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258624 00000100:00100000:1.0:1789448101.560896:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258240 00000100:00100000:1.0:1789448101.560898:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258240 00000100:00100000:1.0:1789448101.560908:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859258752 00000100:00100000:1.0:1789448101.560910:0:19002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859258752 00000100:00100000:1.0:1789448101.560920:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789448101.560925:0:19002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859258112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560959:0:19002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859258112:12345-0@lo:400:kworker.0 Request processed in 33us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.560976:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789448101.560988:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859257984:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.560994:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789448101.561000:0:19002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859258624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448101.561056:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859258496:0@lo:400:kworker.0 00000100:00100000:2.0:1789448101.561077:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:502f2cd2-eb84-4c43-be93-396c392bd72c:3635:1876371859257856:0@lo:400:kworker.0 00000100:00100000:2.0:1789448101.561168:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876371859258368:0@lo:400:kworker.0 00000100:00100000:2.0:1789448101.561183:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859258880:0@lo:400:kworker.0 00010000:00080000:2.0:1789448101.561195:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7052d80 x1876371859259392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448101.561217:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3635:1876371859259392:0@lo:400:kworker.0 00000100:00080000:2.0:1789448101.561241:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448101.561245:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448101.561347:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876371859259008:12345-0@lo:400:kworker.0 Request processed in 1478us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448101.561516:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3635:1876371859259008:0@lo:400:kworker.0 00000100:00100000:0.0:1789448101.561566:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789448101.561597:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448101.561605:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859258240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448101.561640:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859258240:12345-0@lo:400:kworker.0 Request processed in 36us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448101.561646:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448101.561661:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448101.561667:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859258752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448101.561696:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859258752:12345-0@lo:400:kworker.0 Request processed in 29us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448101.561701:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789448101.562361:0:19002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859258624:12345-0@lo:400:kworker.0 Request processed in 1360us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.562370:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789448101.562398:0:20323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259648 00000100:00100000:1.0:1789448101.562404:0:20323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259648 00000100:00100000:1.0:1789448101.562474:0:20323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448101.562482:0:20323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859259648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448101.562497:0:20323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789448101.562530:0:20323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859259648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448101.562535:0:20323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448101.564917:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859259648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448101.564969:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859258240:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.564981:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859258752:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.564992:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859259264:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.565003:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859258112:0@lo:400:kworker.0 00000100:00100000:1.0:1789448101.565013:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c826d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859258624:0@lo:400:kworker.0 00010000:00080000:1.0:1789448101.565024:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7050e00 x1876371859259136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00100000:2.0:1789448101.565590:0:19506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 60c24871-0b2b-4850-b97c-73ceca98f51b 00000020:00000080:2.0:1789448101.565596:0:19506:0:(genops.c:885:class_export_put()) final put ffff9517ca4b6000/60c24871-0b2b-4850-b97c-73ceca98f51b 00000020:00000080:2.0:1789448101.565622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517ca4b6000/60c24871-0b2b-4850-b97c-73ceca98f51b for lustre-OST0001 00000020:00000080:2.0:1789448101.565675:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c6431000 for lustre-OST0001 00000100:00100000:1.0:1789448101.566932:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859259136:0@lo:400:kworker.0 00000001:00100000:2.0:1789448101.570947:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000020:00000080:2.0:1789448101.570955:0:18689:0:(genops.c:885:class_export_put()) final put ffff9517fb946800/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000001:00100000:2.0:1789448101.570973:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 60c24871-0b2b-4850-b97c-73ceca98f51b 00000020:00000080:2.0:1789448101.570975:0:18689:0:(genops.c:885:class_export_put()) final put ffff9517fb944000/60c24871-0b2b-4850-b97c-73ceca98f51b 00000020:00000080:2.0:1789448101.570991:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fb946800/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 for lustre-OST0000 00000020:00000080:2.0:1789448101.571027:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fb944000/60c24871-0b2b-4850-b97c-73ceca98f51b for lustre-OST0000 00000020:00000080:2.0:1789448101.571042:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fb940000 for lustre-OST0000 00000020:00000080:2.0:1789448101.571046:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fb941800 for lustre-OST0000 00000001:00080000:1.0:1789448101.572414:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1789448101.572595:0:17166:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1789448101.572648:0:17225:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1789448101.572660:0:17225:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:1.0:1789448101.694485:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448102.330755:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448102.583862:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859259776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448102.583937:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448102.584397:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259776 00000100:00100000:3.0:1789448102.584406:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259776 00000100:00100000:3.0:1789448102.584536:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789448102.584546:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859259776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448102.584583:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789448102.584639:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859259776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448102.584646:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789448102.584733:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859259776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789448103.349689:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448104.127305:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448104.127362:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448104.127399:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448104.127486:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849756160 00000100:00100000:3.0:1789448104.127496:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849756160 00000100:00100000:3.0:1789448104.127555:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849756416 00000100:00100000:3.0:1789448104.127558:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849756416 00000100:00100000:3.0:1789448104.127570:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849756288 00000100:00100000:3.0:1789448104.127573:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849756288 00000100:00100000:3.0:1789448104.127588:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 4 00000100:00100000:3.0:1789448104.127596:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+15:2390:x1876371849756160:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448104.127610:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448104.127628:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b2f200/0x6522da1199ce40ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb86f48 expref: 15 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.127648:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448104.127693:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+14:2390:x1876371849756160:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 98us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448104.127701:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 4 00000100:00100000:3.0:1789448104.127718:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 5 00000100:00100000:3.0:1789448104.127724:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+13:2390:x1876371849756416:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448104.127731:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448104.127739:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477aa00/0x6522da1199ce4146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8702f expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.127765:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448104.127783:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+12:2390:x1876371849756416:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 59us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448104.127789:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 5 00000100:00100000:3.0:1789448104.127802:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 6 00000100:00100000:3.0:1789448104.127808:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+11:2390:x1876371849756288:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448104.127815:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448104.127823:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b2fc00/0x6522da1199ce40c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb86f79 expref: 11 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.127831:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448104.127848:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+10:2390:x1876371849756288:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 40us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448104.127853:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 6 00000100:00100000:0.0:1789448104.128944:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448104.129015:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849756672 00000100:00100000:2.0:1789448104.129022:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849756672 00000100:00100000:2.0:1789448104.129081:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 38 00000100:00100000:2.0:1789448104.129102:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+6:2388:x1876371849756672:12345-192.168.206.38@tcp:9:umount.0 00000020:00000080:2.0:1789448104.129143:0:18694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce40e4 00000020:00010000:2.0:1789448104.129152:0:18694:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9517fb942800: total 0 00000100:00080000:2.0:1789448104.129163:0:18694:0:(import.c:65:import_set_state_nolock()) ffff9517fb943000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789448104.129227:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1789448104.129502:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1789448104.129645:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+4:2388:x1876371849756672:12345-192.168.206.38@tcp:9:umount.0 Request processed in 555us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448104.129652:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 38 00000020:00010000:3.0:1789448104.130058:0:17939:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9517fb942800: total 0 00010000:00010000:3.0:1789448104.130106:0:17939:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9517fb942800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1789448104.130207:0:17939:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789448104.130211:0:17939:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789448104.130234:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1024ee8/0x6522da1199ce444f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8710f expref: 3 pid: 19002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.130255:0:17939:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9517fb942800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789448104.130281:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448104.130283:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448104.130285:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448104.142255:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448104.142526:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849757568 00000100:00100000:2.0:1789448104.142536:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849757568 00000100:00100000:2.0:1789448104.142612:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 76 00000100:00100000:2.0:1789448104.142623:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+12:2388:x1876371849757568:12345-192.168.206.38@tcp:39:umount.0 00000020:00000080:2.0:1789448104.142654:0:18258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce40cf 00000020:00010000:2.0:1789448104.142670:0:18258:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9516c7622800: total 0 00000100:00080000:2.0:1789448104.142675:0:18258:0:(import.c:65:import_set_state_nolock()) ffff9516c7625800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448104.142707:0:18258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:2.0:1789448104.142857:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+11:2388:x1876371849757568:12345-192.168.206.38@tcp:39:umount.0 Request processed in 237us (611us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1789448104.142866:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 76 00000100:00080000:0.0:1789448104.142978:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789448104.144123:0:17175:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9516c7622800: total 0 00010000:00010000:3.0:1789448104.144152:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448104.144207:0:17175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9516c7622800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1789448104.144238:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9516c6883e00) 00010000:00010000:3.0:1789448104.144241:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789448104.144252:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d477a600/0x6522da1199ce427a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87075 expref: 10 pid: 18258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144275:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9517f27b6f00) 00010000:00010000:3.0:1789448104.144278:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448104.144282:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd75f400/0x6522da1199ce43fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb870ec expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144295:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9517f27b6100) 00010000:00010000:3.0:1789448104.144298:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448104.144301:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce41b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8703d expref: 8 pid: 18258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144325:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517f27b6e00) 00010000:00010000:3.0:1789448104.144328:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448104.144332:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce41f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8704b expref: 7 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144344:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9517c29ab900) 00010000:00010000:3.0:1789448104.144347:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448104.144350:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d477be00/0x6522da1199ce4464 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87116 expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144362:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9517c29ab000) 00010000:00010000:3.0:1789448104.144364:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448104.144375:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90efa00/0x6522da1199ce419a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87036 expref: 5 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144392:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9517c29ab900) 00010000:00010000:3.0:1789448104.144394:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448104.144398:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ee400/0x6522da1199ce43a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb870d7 expref: 4 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448104.144419:0:17175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9516c7622800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1789448104.144433:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448104.144435:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448104.144436:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448104.155535:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448104.155619:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849757696 00000100:00100000:3.0:1789448104.155629:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849757696 00000100:00100000:3.0:1789448104.155700:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 77 00000100:00100000:3.0:1789448104.155711:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c826d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+5:2388:x1876371849757696:12345-192.168.206.38@tcp:39:umount.0 00000020:00000080:3.0:1789448104.155741:0:17187:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce40d6 00000100:00080000:3.0:1789448104.155758:0:17187:0:(import.c:65:import_set_state_nolock()) ffff9516c7626000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448104.155790:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789448104.156009:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c826d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fc1a3d2-d7b9-4d99-9b27-590450f1aef3+3:2388:x1876371849757696:12345-192.168.206.38@tcp:39:umount.0 Request processed in 300us (483us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789448104.156017:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 77 00010000:00010000:2.0:1789448104.156118:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789448104.156663:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789448104.382124:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448105.397688:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448105.653677:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448105.653697:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859259904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789448105.653771:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448105.654369:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859259904 00000100:00100000:3.0:1789448105.654379:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859259904 00000100:00100000:3.0:1789448105.654448:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789448105.654457:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859259904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789448105.654511:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789448105.654559:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859259904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448105.654566:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789448105.654683:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448105.654694:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859260032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448105.654728:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789448105.654771:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448105.654807:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859259904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789448105.654877:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260032 00000100:00100000:0.0:1789448105.654882:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260032 00000100:00100000:0.0:1789448105.654915:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789448105.654923:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859260032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448105.654943:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789448105.654991:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859260032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448105.654997:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789448105.655072:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859260032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448105.655189:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448105.655199:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859260160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789448105.655226:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448105.662550:0:18259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260160 00000100:00100000:1.0:1789448105.662565:0:18259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260160 00000100:00100000:1.0:1789448105.662632:0:18259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448105.662642:0:18259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859260160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789448105.662677:0:18259:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789448105.662758:0:18259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859260160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (7531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448105.662766:0:18259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448105.662825:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859260160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789448105.801324:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448105.801394:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448105.801604:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849757824 00000100:00100000:1.0:1789448105.801615:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849757824 00000100:00100000:1.0:1789448105.801673:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849757952 00000100:00100000:1.0:1789448105.801676:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849757952 00000100:00100000:1.0:1789448105.801705:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:1.0:1789448105.801715:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+11:2389:x1876371849757824:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448105.801730:0:18340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448105.801749:0:18340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90efe00/0x6522da1199ce40f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb86fb8 expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448105.801766:0:18340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448105.801814:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+10:2389:x1876371849757824:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 101us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448105.801822:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:1.0:1789448105.801844:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 8 00000100:00100000:1.0:1789448105.801851:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+9:2389:x1876371849757952:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448105.801858:0:18340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448105.801867:0:18340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb86fe9 expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448105.801876:0:18340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448105.801893:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+8:2389:x1876371849757952:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448105.801899:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 8 00000100:00100000:1.0:1789448105.803830:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448105.803916:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849758080 00000100:00100000:3.0:1789448105.803928:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849758080 00000100:00100000:3.0:1789448105.803993:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 9 00000100:00100000:3.0:1789448105.804003:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+8:2392:x1876371849758080:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448105.804020:0:18340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448105.804040:0:18340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b2ee00/0x6522da1199ce413f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87028 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448105.804059:0:18340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448105.804129:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+7:2392:x1876371849758080:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448105.804137:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 9 00000100:00100000:1.0:1789448105.825090:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448105.828272:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849758336 00000100:00100000:2.0:1789448105.828293:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849758336 00000100:00080000:1.0:1789448105.828387:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448105.828660:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 78 00000100:00100000:2.0:1789448105.828684:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+6:2388:x1876371849758336:12345-192.168.206.38@tcp:39:umount.0 00000020:00000080:2.0:1789448105.828737:0:18258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce410e 00000020:00010000:2.0:1789448105.828748:0:18258:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9517fb944800: total 0 00000100:00080000:2.0:1789448105.828753:0:18258:0:(import.c:65:import_set_state_nolock()) ffff9517fb945000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448105.828926:0:18258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:2.0:1789448105.829234:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2388:x1876371849758336:12345-192.168.206.38@tcp:39:umount.0 Request processed in 556us (4165us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1789448105.829244:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 78 00000020:00010000:3.0:1789448105.830731:0:17174:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9517fb944800: total 0 00010000:00010000:3.0:1789448105.830818:0:17174:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9517fb944800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789448105.830862:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517f27b6e00) 00010000:00010000:3.0:1789448105.830867:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448105.830881:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b8dc00/0x6522da1199ce4203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87052 expref: 4 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448105.830911:0:17174:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9517fb944800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789448105.830924:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448105.830926:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448105.830929:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448105.838158:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448105.838512:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849758464 00000100:00100000:3.0:1789448105.838525:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849758464 00000100:00100000:3.0:1789448105.838607:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 79 00000100:00100000:3.0:1789448105.838619:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60c24871-0b2b-4850-b97c-73ceca98f51b+5:2388:x1876371849758464:12345-192.168.206.38@tcp:39:umount.0 00000020:00000080:3.0:1789448105.838666:0:17187:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce4115 00000100:00080000:3.0:1789448105.838677:0:17187:0:(import.c:65:import_set_state_nolock()) ffff9517fb947800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448105.838707:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1789448105.838866:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60c24871-0b2b-4850-b97c-73ceca98f51b+3:2388:x1876371849758464:12345-192.168.206.38@tcp:39:umount.0 Request processed in 249us (720us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789448105.838874:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 79 00000100:00080000:1.0:1789448105.839141:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789448105.839304:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448105.929544:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448105.929751:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849758720 00000100:00100000:1.0:1789448105.929764:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849758720 00000100:00100000:1.0:1789448105.929887:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 173 00000100:00100000:1.0:1789448105.929900:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f8168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+7:2388:x1876371849758720:12345-192.168.206.38@tcp:251:umount.0 00000020:00000080:1.0:1789448105.929957:0:17180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce40ac 00000020:00010000:1.0:1789448105.929967:0:17180:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9517e7d87000: total 0 00000100:00080000:1.0:1789448105.929973:0:17180:0:(import.c:65:import_set_state_nolock()) ffff9517e7d85800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789448105.930057:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f8168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c6a61a9-1e2c-47ac-97e7-9644c0309e9e+3:2388:x1876371849758720:12345-192.168.206.38@tcp:251:umount.0 Request processed in 160us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448105.930065:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 173 00000020:00010000:3.0:1789448105.930152:0:17175:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9517e7d87000: total 0 00010000:00010000:3.0:1789448105.930221:0:17175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9517e7d87000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789448105.930261:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477b200/0x6522da1199ce40b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb86f41 expref: 2 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448105.930284:0:17175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9517e7d87000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789448105.930294:0:17175:0:(genops.c:885:class_export_put()) final put ffff9517e7d87000/4c6a61a9-1e2c-47ac-97e7-9644c0309e9e 00010000:00010000:3.0:1789448105.930310:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448105.930312:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448105.930314:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789448105.930326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517e7d87000/4c6a61a9-1e2c-47ac-97e7-9644c0309e9e for MGS 00000020:00000080:3.0:1789448105.930359:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517e7d85800 for MGS 00010000:00010000:3.0:1789448106.421779:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448106.677908:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448106.677940:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859260288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448106.678029:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448106.678170:0:20323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260288 00000100:00100000:2.0:1789448106.678187:0:20323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260288 00000100:00100000:2.0:1789448106.678267:0:20323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789448106.678281:0:20323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859260288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448106.678318:0:20323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789448106.678406:0:20323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859260288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448106.678414:0:20323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789448106.678572:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448106.678970:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859260672:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.679015:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.679040:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859261184:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.679059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.679088:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859261696:0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.679117:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859260416:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.679120:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.679192:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859260288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448106.679217:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789448106.679222:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859260800:0@lo:400:kworker.0 00000100:00100000:1.0:1789448106.679353:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859260544:0@lo:400:kworker.0 00000100:00100000:3.0:1789448106.680085:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261696 00000100:00100000:3.0:1789448106.680095:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261696 00000100:00100000:3.0:1789448106.680165:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789448106.680176:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859261696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.682455:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.682545:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859261312:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.682578:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.682600:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517cc7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3632:1876371859261824:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.682624:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.682673:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260800 00000100:00100000:0.0:1789448106.682682:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260800 00000100:00100000:2.0:1789448106.685752:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.685779:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261312 00000100:00100000:0.0:1789448106.685793:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261312 00000100:00100000:0.0:1789448106.685825:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261824 00000100:00100000:0.0:1789448106.685828:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261824 00000100:00100000:2.0:1789448106.685846:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859260928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.685862:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789448106.685876:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859260800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.685905:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448106.685953:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859261440:0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.686008:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.686022:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859260800:12345-0@lo:400:kworker.0 Request processed in 147us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448106.686031:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789448106.686042:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859261952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789448106.686065:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261440 00000100:00100000:0.0:1789448106.686071:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261440 00000100:00100000:2.0:1789448106.686088:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448106.686111:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789448106.686120:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859261312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.686163:0:18259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260928 00000100:00100000:0.0:1789448106.686170:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859261312:12345-0@lo:400:kworker.0 Request processed in 51us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448106.686174:0:18259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260928 00000100:00100000:0.0:1789448106.686180:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789448106.686201:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789448106.686211:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1876371859261824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.686232:0:18259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789448106.686248:0:18259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859260928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.686256:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1876371859261824:12345-0@lo:400:kworker.0 Request processed in 46us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448106.686265:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789448106.686286:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789448106.686295:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859261440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.686317:0:18259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859260928:12345-0@lo:400:kworker.0 Request processed in 73us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448106.686325:0:18259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789448106.686349:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859261440:12345-0@lo:400:kworker.0 Request processed in 55us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448106.686357:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261952 00000100:00100000:0.0:1789448106.686358:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789448106.686365:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261952 00000100:00100000:2.0:1789448106.686398:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789448106.686404:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859261952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789448106.686419:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789448106.686486:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859261952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448106.686492:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789448106.686539:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448106.686547:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789448106.686551:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448106.686577:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859261952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789448106.686599:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859260800:0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.686600:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859260928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.686625:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859261312:0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.686635:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859261440:0@lo:400:kworker.0 00010000:00080000:0.0:1789448106.686672:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517cc7d1880 x1876371859261824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448106.686686:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517cc7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3632:1876371859261824:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.686855:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260672 00000100:00100000:0.0:1789448106.686860:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260672 00000100:00100000:0.0:1789448106.686910:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261184 00000100:00100000:0.0:1789448106.686914:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261184 00000100:00100000:0.0:1789448106.686932:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789448106.686939:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cc7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859260672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.686988:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cc7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859260672:12345-0@lo:400:kworker.0 Request processed in 50us (7972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448106.686995:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789448106.687007:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789448106.687013:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859261184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.687040:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859261184:12345-0@lo:400:kworker.0 Request processed in 28us (7980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448106.687046:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789448106.687138:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448106.687279:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859260672:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.687298:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859261184:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.687348:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260416 00000100:00100000:0.0:1789448106.687353:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260416 00000100:00100000:0.0:1789448106.687387:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789448106.687786:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f8169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3634:x1876371859260416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.687850:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f8169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3634:x1876371859260416:12345-0@lo:400:kworker.0 Request processed in 456us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448106.687870:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789448106.688569:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859260416:0@lo:400:kworker.0 00000100:00100000:1.0:1789448106.690977:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448106.691055:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859261056:0@lo:400:kworker.0 00000100:00100000:1.0:1789448106.691107:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448106.691140:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3635:1876371859261568:0@lo:400:kworker.0 00000100:00100000:1.0:1789448106.691166:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448106.691202:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261568 00000100:00100000:1.0:1789448106.691210:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261568 00000100:00100000:1.0:1789448106.691273:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789448106.691283:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876371859261568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448106.691337:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876371859261568:12345-0@lo:400:kworker.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448106.691345:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1789448106.691504:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7413480 x1876371859261568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448106.691520:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3635:1876371859261568:0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.691638:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859260544 00000100:00100000:0.0:1789448106.691644:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859260544 00000100:00100000:0.0:1789448106.691686:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789448106.691694:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859260544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448106.691739:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859260544:12345-0@lo:400:kworker.0 Request processed in 47us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448106.691746:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789448106.691825:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789448106.691840:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859261056 00000100:00100000:2.0:1789448106.691845:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859261056 00000100:00100000:2.0:1789448106.691884:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789448106.691892:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859261056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448106.691931:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859261056:12345-0@lo:400:kworker.0 Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448106.691944:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789448106.693256:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859260544:0@lo:400:kworker.0 00000100:00100000:1.0:1789448106.693273:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859261056:0@lo:400:kworker.0 00000100:00100000:3.0:1789448106.695339:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859261696:12345-0@lo:400:kworker.0 Request processed in 15155us (16208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448106.695369:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789448106.700605:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859261696:0@lo:400:kworker.0 00010000:00010000:2.0:1789448107.449707:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448107.706987:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859262080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448107.707090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448107.708384:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262080 00000100:00100000:0.0:1789448107.708399:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262080 00000100:00100000:0.0:1789448107.708486:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448107.708498:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859262080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789448107.708540:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789448107.708617:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859262080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448107.708625:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448107.708685:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859262080:0@lo:13:osp-pre-0-0.0 00000020:01000004:3.0:1789448107.795616:0:20755:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789448107.824655:0:20755:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789448107.824738:0:20755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.824758:0:20755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.824767:0:20755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.824775:0:20755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.824795:0:20755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448107.824801:0:20755:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789448107.824828:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448107.824833:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789448107.824840:0:20755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789448107.824871:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9517d3af6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789448107.824969:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3631:1876371859262208:0@lo:39:umount.0 00000100:00100000:1.0:1789448107.825049:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448107.825375:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448107.825384:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.825394:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207aa00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448107.825398:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.825409:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448107.825416:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448107.825423:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448107.825426:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789448107.825428:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789448107.825485:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.825491:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448107.825515:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.825522:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff95180207aa00/0x6522da1199ce3c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3c76 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.825535:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.825552:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.825554:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448107.825637:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:502f2cd2-eb84-4c43-be93-396c392bd72c:3632:1876371859262336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448107.825683:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448107.825940:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262336 00000100:00100000:3.0:1789448107.825977:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262336 00000100:00100000:3.0:1789448107.826059:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448107.826089:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fc94a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:502f2cd2-eb84-4c43-be93-396c392bd72c+24:3632:x1876371859262336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448107.826105:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789448107.827572:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262208 00000100:00100000:2.0:1789448107.827596:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262208 00000100:00100000:2.0:1789448107.827709:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789448107.827733:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1876371859262208:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789448107.827791:0:17188:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3ca0 00000100:00080000:2.0:1789448107.827817:0:17188:0:(import.c:65:import_set_state_nolock()) ffff9517efd2b800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789448107.827935:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3631:x1876371859262208:12345-0@lo:39:umount.0 Request processed in 216us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448107.827943:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:2.0:1789448107.827954:0:17188:0:(genops.c:885:class_export_put()) final put ffff9517d33fb800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789448107.828016:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517d3af6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789448107.828027:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3631:1876371859262208:0@lo:39:umount.0 00000100:00080000:2.0:1789448107.828056:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448107.828060:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789448107.828065:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789448107.828379:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95180207a800/0x6522da1199ce3c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3c6f expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.828399:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448107.828449:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fc94a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:502f2cd2-eb84-4c43-be93-396c392bd72c+23:3632:x1876371859262336:12345-0@lo:103:ldlm_bl.0 Request processed in 2382us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448107.828471:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789448107.828539:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789448107.828551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d33fb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789448107.828603:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517efd2b800 for lustre-MDT0000 00000100:00100000:0.0:1789448107.828945:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:502f2cd2-eb84-4c43-be93-396c392bd72c:3632:1876371859262336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448107.831036:0:20755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831058:0:20755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831065:0:20755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831084:0:20755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831229:0:20755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448107.831238:0:20755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831246:0:20755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831275:0:20755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.831282:0:20755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832253:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448107.832277:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832287:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8009e00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448107.832292:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832302:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448107.832310:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448107.832335:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448107.832338:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789448107.832385:0:17939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832393:0:17939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448107.832431:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832439:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c8009e00/0x6522da1199ce3bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3bc7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832473:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448107.832477:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832483:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8009000 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448107.832486:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832493:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448107.832500:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448107.832506:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448107.832508:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789448107.832521:0:17939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832533:0:17939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448107.832557:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.832565:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.832567:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.832569:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448107.832591:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859262592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448107.832672:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448107.832745:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262592 00000100:00100000:3.0:1789448107.832754:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262592 00000100:00100000:3.0:1789448107.832813:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448107.832823:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:502f2cd2-eb84-4c43-be93-396c392bd72c+23:3634:x1876371859262592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448107.833009:0:18340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448107.833028:0:18340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c8009800/0x6522da1199ce3fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3fd3 expref: 23 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.833044:0:18340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448107.833096:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:502f2cd2-eb84-4c43-be93-396c392bd72c+22:3634:x1876371859262592:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448107.833104:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448107.833231:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859262592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448107.833368:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448107.833380:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:502f2cd2-eb84-4c43-be93-396c392bd72c:3632:1876371859262464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448107.833417:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448107.833613:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262464 00000100:00100000:3.0:1789448107.833619:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262464 00000100:00100000:3.0:1789448107.833649:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448107.833656:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:502f2cd2-eb84-4c43-be93-396c392bd72c+22:3632:x1876371859262464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448107.833677:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448107.833689:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c8009200/0x6522da1199ce3bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3bc0 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.833699:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448107.833740:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:502f2cd2-eb84-4c43-be93-396c392bd72c+21:3632:x1876371859262464:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448107.833747:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789448107.833808:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:502f2cd2-eb84-4c43-be93-396c392bd72c:3632:1876371859262464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448107.834013:0:20755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789448107.834024:0:20755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c8009000/0x6522da1199ce3fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448107.834038:0:20755:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789448107.834049:0:20755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834059:0:20755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834067:0:20755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834084:0:20755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.834174:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448107.834180:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.834188:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8d600 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448107.834192:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.834201:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448107.834208:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448107.834213:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789448107.834216:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789448107.834239:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.834246:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789448107.834355:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:502f2cd2-eb84-4c43-be93-396c392bd72c:3635:1876371859262720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448107.834393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448107.834450:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.834491:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.834493:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.834495:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448107.834547:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262720 00000100:00100000:1.0:1789448107.834553:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262720 00000100:00100000:1.0:1789448107.834597:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789448107.834606:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:502f2cd2-eb84-4c43-be93-396c392bd72c+21:3635:x1876371859262720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448107.834617:0:18340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448107.834629:0:18340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477a800/0x6522da1199ce417e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce4177 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448107.834641:0:18340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448107.834735:0:20755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789448107.834741:0:20755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce4177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce417e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448107.834751:0:20755:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789448107.834765:0:20755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834774:0:20755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834780:0:20755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834787:0:20755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448107.834798:0:20755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448107.834801:0:20755:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789448107.834804:0:20755:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789448107.834854:0:20755:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789448107.834858:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789448107.834864:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789448107.834871:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789448107.834878:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9516c7925800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448107.834884:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9517f276d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448107.834888:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9516c7706000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448107.834893:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9517fd51d000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789448107.834900:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9517fb944800 60c24871-0b2b-4850-b97c-73ceca98f51b 192.168.206.38@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1789448107.834906:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9516c7622800 0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 192.168.206.38@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:2.0:1789448107.834911:0:20755:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9516c76eb380) has exports, disconnecting them 00000020:00080000:2.0:1789448107.834917:0:20755:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9516c7925800), last request at 1789448106 00000020:00000080:2.0:1789448107.834925:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3fa2 00000100:00080000:2.0:1789448107.834952:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9516c7924000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789448107.835004:0:20755:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c7925800): rc 0 00000020:00000080:2.0:1789448107.835007:0:20755:0:(genops.c:885:class_export_put()) final put ffff9516c7925800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789448107.835019:0:20755:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9517f276d000), last request at 1789448106 00000020:00000080:2.0:1789448107.835023:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3e3d 00000100:00080000:2.0:1789448107.835028:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9517f276c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789448107.835034:0:20755:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9517f276d000): rc 0 00000020:00000080:2.0:1789448107.835036:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517f276d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789448107.835040:0:20755:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9516c7706000), last request at 1789448039 00000020:00000080:2.0:1789448107.835043:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d8e 00000100:00080000:2.0:1789448107.835046:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9516c7701000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789448107.835051:0:20755:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c7706000): rc 0 00000020:00000080:2.0:1789448107.835053:0:20755:0:(genops.c:885:class_export_put()) final put ffff9516c7706000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789448107.835057:0:20755:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9517fd51d000), last request at 1789448039 00000020:00000080:2.0:1789448107.835060:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d2c 00000100:00080000:2.0:1789448107.835063:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9517f77a4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448107.835069:0:20755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:2.0:1789448107.835190:0:20755:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9517fd51d000): rc 0 00000004:00000080:2.0:1789448107.835197:0:20755:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb33cc15a3ae0 00000100:00080000:2.0:1789448107.835221:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789448107.835225:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789448107.836214:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448107.836226:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.836238:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8008c00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448107.836242:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.836253:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448107.836271:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448107.836277:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448107.836281:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789448107.836284:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789448107.836327:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.836334:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448107.836363:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.836370:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c8008c00/0x6522da1199ce3bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3bb9 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.836403:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.836404:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.836406:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448107.836414:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448107.836422:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448107.836443:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859262848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448107.836520:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448107.836574:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262848 00000100:00100000:3.0:1789448107.836582:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262848 00000100:00100000:3.0:1789448107.836634:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448107.836644:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:502f2cd2-eb84-4c43-be93-396c392bd72c+21:3633:x1876371859262848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448107.836661:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448107.836677:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95180207ba00/0x6522da1199ce3bb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3bb2 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448107.836692:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448107.836727:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:502f2cd2-eb84-4c43-be93-396c392bd72c+20:3633:x1876371859262848:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448107.836734:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448107.836773:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859262848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448107.836795:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448107.837624:0:20755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789448107.837657:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9517fda0b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789448107.837826:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859262976:0@lo:39:umount.0 00000100:00100000:3.0:1789448107.837892:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448107.838038:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:502f2cd2-eb84-4c43-be93-396c392bd72c+19:3635:x1876371859262720:12345-0@lo:103:ldlm_bl.0 Request processed in 3430us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448107.838050:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448107.838371:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859262976 00000100:00100000:2.0:1789448107.838381:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859262976 00000100:00100000:2.0:1789448107.838433:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789448107.838442:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1876371859262976:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789448107.838505:0:17192:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3db8 00000100:00080000:2.0:1789448107.838530:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9517f26fe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448107.838558:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789448107.838704:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3631:x1876371859262976:12345-0@lo:39:umount.0 Request processed in 263us (812us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789448107.838711:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789448107.838793:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789448107.838798:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789448107.838814:0:20755:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789448107.838877:0:20755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789448107.838894:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9516c8007000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789448107.838904:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789448107.838906:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1789448107.838917:0:20755:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789448107.838987:0:20755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789448107.838997:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9517f6030000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789448107.839042:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9516c76eb380) has no exports 00000100:00100000:3.0:1789448107.839138:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859263104:0@lo:9:umount.0 00000100:00100000:3.0:1789448107.839179:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448107.839218:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859263232:0@lo:9:umount.0 00000100:00100000:3.0:1789448107.839240:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789448107.839289:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fda0b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789448107.839297:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859262976:0@lo:39:umount.0 00000100:00100000:3.0:1789448107.839323:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859263104 00000100:00100000:3.0:1789448107.839327:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859263104 00000100:00100000:3.0:1789448107.839362:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859263232 00000100:00100000:3.0:1789448107.839364:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859263232 00000100:00100000:3.0:1789448107.839383:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448107.839391:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1876371859263104:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789448107.839409:0:18692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3e7c 00000100:00080000:3.0:1789448107.839417:0:18692:0:(import.c:65:import_set_state_nolock()) ffff9516c6659000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448107.839476:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789448107.839600:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3631:x1876371859263104:12345-0@lo:9:umount.0 Request processed in 208us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448107.839607:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448107.839623:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789448107.839630:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1876371859263232:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789448107.839641:0:18692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3fe8 00000100:00080000:3.0:1789448107.839647:0:18692:0:(import.c:65:import_set_state_nolock()) ffff9516c77c3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448107.839670:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789448107.839744:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3631:x1876371859263232:12345-0@lo:9:umount.0 Request processed in 114us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448107.839751:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789448107.839772:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789448107.839787:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c8007000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789448107.839793:0:3631:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789448107.839801:0:3631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448107.839805:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859263104:0@lo:9:umount.0 00000100:00080000:3.0:1789448107.839815:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f6030000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789448107.839823:0:3631:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789448107.839825:0:3631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448107.839827:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859263232:0@lo:9:umount.0 00010000:00010000:3.0:1789448107.839851:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448107.840018:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448107.840178:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:502f2cd2-eb84-4c43-be93-396c392bd72c:3635:1876371859262720:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789448107.840385:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7925800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789448107.840443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f276d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789448107.840493:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7706000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789448107.840519:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c7924000 for lustre-MDT0000 00000020:00000080:0.0:1789448107.840524:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517f276c800 for lustre-MDT0000 00000020:00000080:0.0:1789448107.840528:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c7701000 for lustre-MDT0000 00000020:00080000:2.0:1789448107.849446:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9516c76eb380) has no exports 00000020:00000080:2.0:1789448107.903843:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c0d 00000020:00000080:2.0:1789448107.903858:0:20755:0:(genops.c:885:class_export_put()) final put ffff9516c7ad1000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789448107.903881:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789448107.903932:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7ad1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789448107.903981:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448107.903994:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789448107.903999:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9517f75b0000) has no exports 00000020:00000080:3.0:1789448107.921977:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c06 00000020:00000080:3.0:1789448107.922000:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517caa37800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789448107.922102:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448107.922116:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789448107.922119:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517caa32000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789448107.922123:0:20755:0:(genops.c:844:class_export_destroy()) destroying export ffff9517caa32000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789448107.922131:0:20755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789448107.922221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517caa37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789448108.469977:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448109.494938:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789448109.752746:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789448109.752759:0:17918:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1789448109.752765:0:17918:0:(genops.c:885:class_export_put()) final put ffff9517f77a5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789448109.752783:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 60c24871-0b2b-4850-b97c-73ceca98f51b 00000001:00080000:0.0:1789448109.752788:0:17918:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1789448109.752790:0:17918:0:(genops.c:885:class_export_put()) final put ffff9517fb945800/60c24871-0b2b-4850-b97c-73ceca98f51b 00000001:00100000:0.0:1789448109.752794:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000001:00080000:0.0:1789448109.752797:0:17918:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1789448109.752799:0:17918:0:(genops.c:885:class_export_put()) final put ffff9516c7623000/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000020:00000080:2.0:1789448109.753085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789448109.753229:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fb945800/60c24871-0b2b-4850-b97c-73ceca98f51b for lustre-MDT0001 00000020:00000080:2.0:1789448109.753263:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7623000/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 for lustre-MDT0001 00000020:00000080:2.0:1789448109.753291:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517f26fe800 for lustre-MDT0001 00000020:00000080:2.0:1789448109.753295:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fb947800 for lustre-MDT0001 00000020:00000080:2.0:1789448109.753298:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c7626000 for lustre-MDT0001 00000001:00100000:1.0:1789448109.753345:0:19506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448109.753349:0:19506:0:(genops.c:885:class_export_put()) final put ffff9516c77c1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789448109.753365:0:19506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000020:00000080:1.0:1789448109.753367:0:19506:0:(genops.c:885:class_export_put()) final put ffff9517fb942800/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000020:00000080:0.0:1789448109.753424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c77c1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789448109.753999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fb942800/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 for lustre-OST0001 00000020:00000080:0.0:1789448109.754021:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c77c3800 for lustre-OST0001 00000020:00000080:0.0:1789448109.754025:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fb943000 for lustre-OST0001 00000001:00100000:1.0:1789448109.754828:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789448109.754834:0:17166:0:(genops.c:885:class_export_put()) final put ffff9517fd51d000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789448109.754856:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 60c24871-0b2b-4850-b97c-73ceca98f51b 00000001:00080000:1.0:1789448109.754864:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1789448109.754867:0:17166:0:(genops.c:885:class_export_put()) final put ffff9517fb944800/60c24871-0b2b-4850-b97c-73ceca98f51b 00000001:00100000:1.0:1789448109.754872:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000001:00080000:1.0:1789448109.754875:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:1.0:1789448109.754877:0:17166:0:(genops.c:885:class_export_put()) final put ffff9516c7622800/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 00000020:00000080:2.0:1789448109.755177:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fd51d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789448109.755218:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fb944800/60c24871-0b2b-4850-b97c-73ceca98f51b for lustre-MDT0000 00000020:00000080:2.0:1789448109.755253:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7622800/0fc1a3d2-d7b9-4d99-9b27-590450f1aef3 for lustre-MDT0000 00000020:00000080:2.0:1789448109.755279:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517f77a4000 for lustre-MDT0000 00000020:00000080:2.0:1789448109.755284:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fb945000 for lustre-MDT0000 00000020:00000080:2.0:1789448109.755287:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c7625800 for lustre-MDT0000 00000020:01000000:3.0:1789448109.941687:0:20755:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517fd8d0b40 - data ffff9517ec878288/ffff9516c693dc00 00000020:01000000:3.0:1789448109.941846:0:20755:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517e0750120 - data ffff9517ec8a7870/ffff9517e70eb800 00000001:00000004:3.0:1789448109.946880:0:20755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:3.0:1789448110.018027:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789448110.018036:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789448110.018050:0:20755:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9516c83aca80 x1876371859262976/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789448117 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448110.018085:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789448110.019697:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789448110.019703:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789448110.019736:0:20755:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448110.019738:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789448110.020088:0:17210:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789448110.020092:0:17210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789448110.020102:0:17210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789448110.020845:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789448110.020850:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1789448110.020870:0:20755:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448110.020872:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789448110.021099:0:17212:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789448110.021125:0:17212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1789448110.021133:0:17212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789448110.022089:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3bd5 00000020:00000080:3.0:1789448110.022099:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517f277c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789448110.022485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f277c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789448110.023792:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3bea 00000020:00000080:3.0:1789448110.023802:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517efd2e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789448110.023852:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789448110.023857:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.023864:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789448110.023869:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9516c76e99c0) has no exports 00000004:01000000:3.0:1789448110.024013:0:20755:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789448110.024021:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c4c 00000020:00000080:3.0:1789448110.024025:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517d33fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448110.030716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517efd2e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789448110.031937:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789448110.031950:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.031962:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448110.031967:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9516c6734d40) has no exports 00000020:00000080:3.0:1789448110.031975:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c45 00000020:00000080:3.0:1789448110.031983:0:20755:0:(genops.c:885:class_export_put()) final put ffff9516c8001000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789448110.032371:0:20755:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789448110.032376:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789448110.032393:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789448110.032399:0:20755:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448110.032401:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789448110.032435:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.032441:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448110.032448:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c37 00000020:00000080:3.0:1789448110.032453:0:20755:0:(genops.c:885:class_export_put()) final put ffff9516c6a45000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789448110.032457:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789448110.032497:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.032501:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448110.032504:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9517ca3499c0) has no exports 00000020:00000080:3.0:1789448110.032509:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c30 00000020:00000080:3.0:1789448110.032512:0:20755:0:(genops.c:885:class_export_put()) final put ffff9516c8002800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789448110.032826:0:20755:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789448110.032829:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789448110.032832:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789448110.032836:0:20755:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448110.032837:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789448110.032858:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.032863:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789448110.032874:0:20755:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789448110.032880:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c22 00000020:00000080:3.0:1789448110.032884:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517caa34000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789448110.032888:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789448110.032891:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.032895:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448110.032897:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9517f75b4d40) has no exports 00000020:00000080:3.0:1789448110.032901:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c1b 00000020:00000080:3.0:1789448110.032904:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517fda0b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789448110.033958:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d33fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789448110.033975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c8001000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789448110.033982:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517f6030000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789448110.033989:0:36:0:(genops.c:885:class_export_put()) final put ffff9516c6a47000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448110.033992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c6a47000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789448110.033995:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448110.034080:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c6a45000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789448110.034086:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c8002800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789448110.034090:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c8007000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789448110.034096:0:36:0:(genops.c:885:class_export_put()) final put ffff9517caa31000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448110.034098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517caa31000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789448110.034102:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448110.034131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517caa34000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789448110.034136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fda0b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789448110.087924:0:20755:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789448110.087933:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789448110.087937:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789448110.087945:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789448110.088037:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.088048:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448110.088084:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.088088:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448110.088093:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517f277d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789448110.088097:0:20755:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f277d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789448110.088107:0:20755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789448110.088226:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fda0b800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789448110.088234:0:36:0:(genops.c:885:class_export_put()) final put ffff9517caa31800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789448110.088243:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517caa31800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789448110.088252:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448110.088614:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3bf1 00000020:00000080:3.0:1789448110.088622:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517efd2d800/lustre-MDD0000_UUID 00000020:01000000:3.0:1789448110.088666:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789448110.088671:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.088676:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789448110.088680:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9516c76ecd40) has no exports 00000020:00000080:3.0:1789448110.088702:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.088706:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789448110.088711:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3bf8 00000020:00000080:3.0:1789448110.088715:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517efd2d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789448110.088979:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517efd2d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789448110.088984:0:36:0:(genops.c:885:class_export_put()) final put ffff9517f277a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789448110.088986:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f277a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789448110.088991:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1789448110.089076:0:20755:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517cc7d8800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789448110.089080:0:20755:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517cc7d8800 3 00000020:01000004:3.0:1789448110.089084:0:20755:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9517cc7d8800 from lustre-MDT0000 00000020:00000080:3.0:1789448110.089101:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.089105:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789448110.089108:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517f277f800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789448110.089110:0:20755:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f277f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789448110.089228:0:20755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789448110.089266:0:20755:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789448110.089270:0:20755:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789448110.089273:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789448110.089277:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.089280:0:20755:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789448110.089286:0:20755:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9517fd6fd000 502f2cd2-eb84-4c43-be93-396c392bd72c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789448110.089291:0:20755:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9517f75b19c0) has exports, disconnecting them 00000020:00080000:3.0:1789448110.089296:0:20755:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9517fd6fd000), last request at 1789448026 00000020:00000080:3.0:1789448110.089312:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3b9d 00000020:00010000:3.0:1789448110.089317:0:20755:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9517fd6fd000: total 1 00000100:00080000:3.0:1789448110.089322:0:20755:0:(import.c:65:import_set_state_nolock()) ffff9517fd6f8800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1789448110.089452:0:17174:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9517fd6fd000: total 1 00010000:00010000:0.0:1789448110.089476:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448110.089515:0:17174:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9517fd6fd000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789448110.089547:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce3f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3f86 expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089564:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c8008a00/0x6522da1199ce3fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3fc5 expref: 15 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089578:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90ef800/0x6522da1199ce3dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3df7 expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089590:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b2e600/0x6522da1199ce3cca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3cc3 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089602:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b2ec00/0x6522da1199ce3bab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3ba4 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089611:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c8008e00/0x6522da1199ce3cbc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3cb5 expref: 11 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089620:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8d400/0x6522da1199ce3e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3e21 expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089631:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90eea00/0x6522da1199ce4154 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce414d expref: 9 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089642:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c8009400/0x6522da1199ce3d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3d72 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089668:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b2f400/0x6522da1199ce3f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3f5c expref: 7 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089680:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477a200/0x6522da1199ce4162 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce415b expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089688:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c8008000/0x6522da1199ce3cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce3cd1 expref: 5 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089698:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8c200/0x6522da1199ce4170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6522da1199ce4169 expref: 4 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448110.089708:0:17174:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9517fd6fd000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789448110.089721:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448110.089723:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448110.089725:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789448110.089773:0:20755:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9517fd6fd000): rc 0 00000020:00000080:3.0:1789448110.089776:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517fd6fd000/502f2cd2-eb84-4c43-be93-396c392bd72c 00000020:00080000:3.0:1789448110.089782:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9517f75b19c0) has no exports 00000100:00100000:3.0:1789448110.089876:0:17181:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9516c5b47600:17181] 2 exiting: rc = 0 00000020:00000080:1.0:1789448110.089998:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517efd2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789448110.090005:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fd6fd000/502f2cd2-eb84-4c43-be93-396c392bd72c for MGS 00000020:00000080:1.0:1789448110.090034:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fd6f8800 for MGS 00000100:00100000:0.0:1789448110.090239:0:17180:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9516c76b1000:17180] 1 exiting: rc = 0 00000100:00100000:0.0:1789448110.090303:0:17179:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9516c76b0c00:17179] 0 exiting: rc = 1 00000100:00100000:3.0:1789448110.090455:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090543:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090549:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090555:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090561:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090566:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090572:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090583:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090590:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090598:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090603:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090609:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090614:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090620:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090625:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090631:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090636:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090642:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090648:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090653:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090658:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090664:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090669:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090674:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090679:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090684:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090691:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090696:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090703:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090708:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090713:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090718:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090724:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090729:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090743:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090750:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090755:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090761:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090766:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090771:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090777:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090782:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090787:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090792:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090798:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090803:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090808:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090812:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090818:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090823:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090828:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090833:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090839:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090844:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090849:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090854:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090859:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090865:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090870:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090875:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090880:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090885:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090890:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448110.090896:0:20755:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789448110.092858:0:20755:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517fd8aa420 - data ffff9517ecaa2000/ffff9517fb8c2c00 00000020:01000000:3.0:1789448110.092973:0:20755:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9516c80ac8a0 - data ffff9517c4700438/ffff9517fdaa1c00 00000020:00000080:3.0:1789448110.093560:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3b81 00000020:00000080:3.0:1789448110.093569:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517cc7d9000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789448110.093594:0:20755:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517cc7d8800 from MGS, refs=2 00000020:01000004:3.0:1789448110.093598:0:20755:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517cc7d8800 2 00000020:01000004:3.0:1789448110.093601:0:20755:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9517cc7d8800 from MGS 00000020:00000080:3.0:1789448110.093622:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.093627:0:20755:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789448110.093631:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517cc7da800/MGS 00000020:00000080:3.0:1789448110.093633:0:20755:0:(genops.c:844:class_export_destroy()) destroying export ffff9517cc7da800/MGS for MGS 00000020:01000000:3.0:1789448110.093640:0:20755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789448110.093700:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789448110.093704:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.093709:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789448110.093715:0:20755:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9517d3af3800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789448110.093720:0:20755:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9516c6a38000) has exports, disconnecting them 00000020:00080000:3.0:1789448110.093725:0:20755:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9517d3af3800), last request at 1789448026 00000020:00000080:3.0:1789448110.093728:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3c84 00000020:00080000:3.0:1789448110.093738:0:20755:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9517d3af3800): rc 0 00000020:00000080:3.0:1789448110.093741:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517d3af3800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789448110.094306:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517cc7d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789448110.094315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d3af3800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789448110.110569:0:20755:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789448110.110577:0:20755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789448110.110582:0:20755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789448110.110589:0:20755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789448110.110744:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448110.110753:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789448110.110760:0:20755:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517cc7d8800 1 00000020:00000080:3.0:1789448110.110766:0:20755:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3b73 00000020:00000080:3.0:1789448110.110774:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517cc7dd000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789448110.110779:0:20755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789448110.110783:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448110.110787:0:20755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789448110.110790:0:20755:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9517f75b3380) has no exports 00000020:00000080:0.0:1789448110.111502:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517d3af6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789448110.111511:0:8:0:(genops.c:885:class_export_put()) final put ffff9517d3af2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789448110.111514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d3af2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789448110.111524:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789448110.111597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517cc7dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789448110.150558:0:20755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448110.150570:0:20755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789448110.150576:0:20755:0:(genops.c:885:class_export_put()) final put ffff9517cc7d9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789448110.150580:0:20755:0:(genops.c:844:class_export_destroy()) destroying export ffff9517cc7d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789448110.150590:0:20755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789448110.150698:0:20755:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9517cc7df000 00000020:02000400:1.0:1789448110.150754:0:20755:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789448110.517687:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448110.774620:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859263360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789448110.774699:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448110.775805:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859263488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789448110.775848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448110.776045:0:20323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859263488 00000100:00100000:0.0:1789448110.776052:0:20323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859263488 00000100:00100000:0.0:1789448110.776122:0:20323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448110.776131:0:20323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859263488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789448110.776156:0:20323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789448110.776203:0:20323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859263488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448110.776210:0:20323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789448110.776217:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859263488:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789448110.776233:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448110.781216:0:18259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859263360 00000100:00100000:2.0:1789448110.781231:0:18259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859263360 00000100:00100000:2.0:1789448110.781307:0:18259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789448110.781316:0:18259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1876371859263360:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789448110.781325:0:18259:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789448110.781410:0:18259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1876371859263360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (6711us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789448110.781417:0:18259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:02020000:1.0:1789448110.783016:0:3633:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1789448110.790319:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789448110.790327:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9517f75ca000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789448110.790332:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789448110.810797:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9517f75ca000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448110.810809:0:3633:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1789448110.810834:0:3633:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9517f75ca000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448110.810923:0:3633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770dc00 x1876371859263616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448110.811009:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859263616:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789448110.811086:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448110.811168:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859263616 00000100:00100000:0.0:1789448110.811176:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859263616 00000100:00100000:0.0:1789448110.811218:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789448110.811225:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859263616:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1789448110.811255:0:17191:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789448110.841093:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859263616:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 29859us (29999us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789448110.841108:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789448110.841143:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f75ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448110.841150:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789448110.841154:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859263616:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1789448111.544113:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448111.797644:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859263744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789448111.797723:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789448111.797727:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448111.797733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789448111.797737:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517f75ca000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448111.797744:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1789448111.797749:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789448111.797758:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9517f75ca000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448111.797784:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c83aca80 x1876371859264000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448111.797796:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859263744 00000100:00100000:3.0:1789448111.797805:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859263744 00000100:00100000:2.0:1789448111.797874:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859264128:0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.797884:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448111.797895:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859263744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789448111.797912:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789448111.797924:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789448111.797940:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859264640:0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.797972:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859263744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448111.797981:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448111.797986:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789448111.798010:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00080000:3.0:1789448111.798012:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448111.798019:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859263872:0@lo:400:kworker.0 00000400:00000100:2.0:1789448111.798066:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876371859263872 offset 0 length 224: 4 00000100:00100000:2.0:1789448111.798086:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3633:1876371859264512:0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.798112:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448111.798146:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859264000:0@lo:38:kworker.0 00000100:00100000:2.0:1789448111.798169:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448111.798204:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264128 00000100:00100000:2.0:1789448111.798209:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264128 00000100:00100000:3.0:1789448111.798219:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264640 00000100:00100000:3.0:1789448111.798226:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264640 00000100:00100000:2.0:1789448111.798245:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789448111.798254:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859264128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.798258:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264512 00000100:00100000:3.0:1789448111.798262:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264512 00000100:00100000:3.0:1789448111.798296:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789448111.798302:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859264128:12345-0@lo:400:kworker.0 Request processed in 48us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448111.798318:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789448111.798322:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1876371859264512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.798348:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789448111.798354:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1876371859264640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.798362:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1876371859264512:12345-0@lo:400:kworker.0 Request processed in 43us (247us total) trans 0 rc 0/0 00000020:00080000:2.0:1789448111.798363:0:17186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789448111.798372:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1789448111.798397:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789448111.798403:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1876371859264640:12345-0@lo:400:kworker.0 Request processed in 46us (424us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789448111.798410:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789448111.798432:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264000 00000100:00100000:2.0:1789448111.798436:0:17192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264000 00000100:00100000:2.0:1789448111.798482:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448111.798487:0:17192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859264000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789448111.798502:0:17192:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789448111.798537:0:17192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859264000:12345-0@lo:38:kworker.0 Request processed in 48us (367us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789448111.798542:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448111.798586:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859264256:0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.798632:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448111.798658:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859264768:0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.798678:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448111.798694:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448111.798700:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859264384:0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.798719:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448111.798734:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264256 00000100:00100000:3.0:1789448111.798740:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264256 00000100:00100000:2.0:1789448111.798754:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264768 00000100:00100000:2.0:1789448111.798761:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264768 00000100:00100000:3.0:1789448111.798764:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264384 00000100:00100000:3.0:1789448111.798769:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264384 00000100:00100000:3.0:1789448111.798784:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789448111.798790:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876371859264256:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789448111.798796:0:18258:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789448111.798800:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789448111.798808:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876371859264768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.798834:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876371859264256:12345-0@lo:400:kworker.0 Request processed in 42us (201us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789448111.798842:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789448111.798851:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876371859264768:12345-0@lo:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448111.798861:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789448111.798875:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789448111.798880:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876371859264384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789448111.798886:0:18258:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1789448111.798889:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789448111.799805:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876371859264384:12345-0@lo:400:kworker.0 Request processed in 918us (1079us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789448111.799814:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789448111.800721:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f75ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448111.800730:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789448111.800734:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859264000:0@lo:38:kworker.0 00000100:00100000:2.0:1789448111.800798:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859263744:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789448111.800828:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789448111.800833:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9516c665d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789448111.800836:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:3.0:1789448111.805946:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9517e7413100 x1876371859264512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448111.805965:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3633:1876371859264512:0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.805982:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859264128:0@lo:400:kworker.0 00000100:00080000:3.0:1789448111.805997:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789448111.806009:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9516c7924800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789448111.806013:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789448111.806019:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9516c7924800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448111.806023:0:3633:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1789448111.806034:0:3633:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9516c7924800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448111.806073:0:3633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f1f80 x1876371859264896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448111.806106:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859264640:0@lo:400:kworker.0 00000100:00100000:3.0:1789448111.810565:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3631:1876371859264896:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789448111.810634:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448111.810693:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859264896 00000100:00100000:3.0:1789448111.810700:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859264896 00000100:00100000:3.0:1789448111.810733:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789448111.810739:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3631:x1876371859264896:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1789448111.810758:0:17187:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789448111.810797:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3631:x1876371859264896:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 57us (163us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789448111.810803:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1789448111.810840:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c7924800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448111.810843:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789448111.810847:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3631:1876371859264896:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789448111.817497:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9516c665d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448111.817508:0:3634:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1789448111.817521:0:3634:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9516c665d000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448111.817842:0:3634:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7410e00 x1876371859265024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448111.817873:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859264384:0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.817889:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3631:1876371859265024:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789448111.817957:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448111.818010:0:18258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265024 00000100:00100000:2.0:1789448111.818017:0:18258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265024 00000100:00100000:2.0:1789448111.818067:0:18258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789448111.818074:0:18258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3631:x1876371859265024:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789448111.818094:0:18258:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789448111.818139:0:18258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3631:x1876371859265024:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 64us (182us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789448111.818146:0:18258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789448111.818188:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c665d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448111.818193:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789448111.818196:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3631:1876371859265024:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1789448111.818257:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789448111.818261:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9516c7700000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789448111.818264:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789448111.818267:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9516c7700000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448111.818269:0:3634:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 441 00000100:00080000:2.0:1789448111.818275:0:3634:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9516c7700000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448111.818290:0:3634:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7410e00 x1876371859265152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448111.818320:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859264256:0@lo:400:kworker.0 00000100:00100000:2.0:1789448111.818328:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3631:1876371859265152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789448111.818370:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448111.818400:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265152 00000100:00100000:2.0:1789448111.818404:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265152 00000100:00100000:2.0:1789448111.818425:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789448111.818430:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3631:x1876371859265152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789448111.818441:0:17187:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789448111.818502:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3631:x1876371859265152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 70us (132us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789448111.818510:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789448111.818546:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c7700000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448111.818551:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789448111.818554:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3631:1876371859265152:0@lo:38:ptlrpcd_00_02.0 00010000:00080000:2.0:1789448111.818582:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9517e7411f80 x1876371859264768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448111.818591:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859264768:0@lo:400:kworker.0 00000040:00080000:1.0:1789448111.930438:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789448112.565621:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789448113.530832:0:20956:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789448113.543140:0:20956:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789448113.543197:0:20956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.543230:0:20956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.543250:0:20956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.543257:0:20956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.543280:0:20956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789448113.543286:0:20956:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789448113.543313:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1789448113.543315:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789448113.543319:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789448113.543333:0:20956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789448113.543334:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789448113.543340:0:20956:0:(import.c:65:import_set_state_nolock()) ffff9516c7700000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789448113.543353:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448113.543358:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:0.0:1789448113.543361:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8c600 already unused, calling callback (ffffffffc127bc20) 00000100:00100000:1.0:1789448113.543363:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:00010000:0.0:1789448113.543368:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448113.543383:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448113.543421:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448113.543429:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448113.543432:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789448113.543436:0:17939:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789448113.543539:0:17939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448113.543548:0:17939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448113.543593:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448113.543601:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c600/0x6522da1199ce3d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3d79 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448113.543617:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448113.543621:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448113.543623:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448113.543801:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:502f2cd2-eb84-4c43-be93-396c392bd72c:3635:1876371859265280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448113.543892:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448113.544072:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265280 00000100:00100000:0.0:1789448113.544082:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265280 00000100:00100000:0.0:1789448113.544140:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448113.544151:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3635:x1876371859265280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789448113.544159:0:17173:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789448113 with bad export cookie 7287626916168612765 00010000:00010000:1.0:1789448113.545603:0:20956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545623:0:20956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545631:0:20956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545638:0:20956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545677:0:20956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448113.545684:0:20956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545691:0:20956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545700:0:20956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545707:0:20956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545729:0:20956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789448113.545738:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448113.545740:0:20956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.545750:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545757:0:20956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.545761:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207a200 already unused, calling callback (ffffffffc127bc20) 00010000:00010000:2.0:1789448113.545764:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1789448113.545768:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448113.545778:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545793:0:20956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.545795:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448113.545817:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8da00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448113.545834:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448113.545835:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.545835:0:20956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448113.545855:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448113.545857:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1789448113.545877:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448113.545885:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.545890:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448113.545892:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789448113.545899:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789448113.545900:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789448113.545904:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789448113.545928:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448113.545935:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448113.546054:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448113.546056:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546073:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff95180207a200/0x6522da1199ce3cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3cd8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448113.546075:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b8da00/0x6522da1199ce3fc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546099:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448113.546102:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448113.546104:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448113.546105:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448113.546109:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448113.546111:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448113.546139:0:20956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789448113.546141:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859265536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448113.546150:0:20956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.546169:0:20956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.546176:0:20956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.546182:0:20956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448113.546199:0:20956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789448113.546203:0:20956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1789448113.546211:0:20956:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1789448113.546289:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448113.546293:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546305:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b400 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448113.546307:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546313:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448113.546320:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448113.546325:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789448113.546327:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789448113.546330:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000004:1.0:1789448113.546349:0:20956:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00010000:00010000:3.0:1789448113.546350:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1789448113.546358:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:3.0:1789448113.546366:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1789448113.546370:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448113.546380:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:3.0:1789448113.546389:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789448113.546390:0:20956:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9517e7d85000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789448113.546415:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d477b400/0x6522da1199ce4169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce4170 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789448113.546426:0:20956:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9516c77c7800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:2.0:1789448113.546427:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448113.546431:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448113.546440:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789448113.546450:0:20956:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9517f80fcd40) has exports, disconnecting them 00010000:00010000:3.0:1789448113.546451:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207b200 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448113.546456:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789448113.546497:0:20956:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9517e7d85000), last request at 1789448111 00010000:00010000:3.0:1789448113.546513:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789448113.546513:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3fb7 10000000:00010000:3.0:1789448113.546526:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448113.546533:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448113.546536:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00080000:1.0:1789448113.546536:0:20956:0:(import.c:65:import_set_state_nolock()) ffff9517e7d80000 : changing import state from FULL to CLOSED 10000000:01000000:3.0:1789448113.546540:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789448113.546563:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546571:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448113.546586:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546594:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff95180207b200/0x6522da1199ce3cc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6522da1199ce3cca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448113.546616:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448113.546619:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:1.0:1789448113.546620:0:20956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9517e7d85000): rc 0 00010000:00010000:3.0:1789448113.546621:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448113.546627:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789448113.546631:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517e7d85000/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:2.0:1789448113.546635:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859265408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448113.546645:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859265664:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789448113.546654:0:20956:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9516c77c7800), last request at 1789448111 00000020:00000080:1.0:1789448113.546662:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3e52 00000100:00080000:1.0:1789448113.546674:0:20956:0:(import.c:65:import_set_state_nolock()) ffff9516c77c5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789448113.546678:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448113.546697:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789448113.546707:0:20956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c77c7800): rc 0 00000020:00000080:1.0:1789448113.546712:0:20956:0:(genops.c:885:class_export_put()) final put ffff9516c77c7800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789448113.546725:0:20956:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb33cc0d87ae0 00000100:00100000:3.0:1789448113.546727:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448113.546731:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265536 00000100:00100000:3.0:1789448113.546735:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859265792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448113.546740:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265536 00000100:00080000:1.0:1789448113.546746:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789448113.546755:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448113.546761:0:20956:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9516c770ed80 x1876371859263360/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789448126 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1789448113.546774:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517e7d85000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:1.0:1789448113.546780:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789448113.546786:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265408 00000100:00100000:2.0:1789448113.546792:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265408 00000100:00100000:2.0:1789448113.546822:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265664 00000020:00000080:3.0:1789448113.546824:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c77c7800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:2.0:1789448113.546826:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265664 00000100:00100000:2.0:1789448113.546847:0:18340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265792 00000100:00100000:2.0:1789448113.546852:0:18340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265792 00000020:00000080:3.0:1789448113.546855:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517e7d80000 for lustre-MDT0001 00000020:00000080:3.0:1789448113.546861:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c77c5800 for lustre-MDT0001 00000100:00100000:2.0:1789448113.546993:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448113.547005:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1876371859265536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789448113.547013:0:18340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789448113 with bad export cookie 7287626916168612765 00010000:00010000:3.0:1789448113.547052:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448113.547106:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1876371859265536:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (689us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789448113.547115:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448113.547136:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448113.547140:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fc94b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1876371859265408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789448113.547145:0:18340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789448113 with bad export cookie 7287626916168612765 00000100:00100000:2.0:1789448113.547191:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fc94b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1876371859265408:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (515us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789448113.547198:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448113.547227:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448113.547246:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3634:x1876371859265664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789448113.547271:0:18340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789448113 with bad export cookie 7287626916168612765 00000100:00080000:3.0:1789448113.547351:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789448113.547356:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789448113.547360:0:3634:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1789448113.547534:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3634:x1876371859265664:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (838us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789448113.547541:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448113.547555:0:18340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448113.547559:0:18340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3634:x1876371859265792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789448113.547564:0:18340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789448113 with bad export cookie 7287626916168612765 00000100:00100000:2.0:1789448113.547631:0:18340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3634:x1876371859265792:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (872us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789448113.547655:0:18340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789448113.547701:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448113.547768:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789448113.548665:0:20956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789448113.548676:0:20956:0:(import.c:65:import_set_state_nolock()) ffff9517f75ca000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1789448113.550077:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448113.551663:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789448113.551669:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1789448113.551684:0:20956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789448113.551746:0:20956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789448113.551772:0:20956:0:(import.c:65:import_set_state_nolock()) ffff9517fd51a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789448113.551788:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789448113.551790:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1789448113.551805:0:20956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789448113.552198:0:20956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789448113.552208:0:20956:0:(import.c:65:import_set_state_nolock()) ffff9516c80b5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789448113.552398:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9517f80fcd40) has no exports 00000100:00080000:3.0:1789448113.559076:0:3634:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.138@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789448113.559081:0:3634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789448113.559092:0:3634:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c83af800 x1876371859263872/t0(0) o400->MGC192.168.206.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789448127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448113.559105:0:3634:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c770f800 x1876371859265280/t0(0) o103->MGC192.168.206.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789448129 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448113.559118:0:3634:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7411f80 x1876371859265536/t0(0) o103->MGC192.168.206.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789448129 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448113.559125:0:3634:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c82f0380 x1876371859265408/t0(0) o103->MGC192.168.206.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789448129 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448113.559131:0:3634:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c82f2a00 x1876371859265664/t0(0) o103->MGC192.168.206.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789448129 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448113.559138:0:3634:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c82f2300 x1876371859265792/t0(0) o103->MGC192.168.206.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789448129 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789448113.559157:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789448113.559161:0:3634:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789448113.559162:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789448113.559527:0:3633:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9517f277e800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1789448113.559528:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448113.559538:0:3634:0:(import.c:545:import_select_connection()) MGC192.168.206.138@tcp: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1789448113.559557:0:3634:0:(import.c:666:import_select_connection()) MGC192.168.206.138@tcp: import ffff9517f277e800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448113.559576:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859265536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448113.559595:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859263872:0@lo:400:kworker.0 00000100:00100000:3.0:1789448113.559606:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:502f2cd2-eb84-4c43-be93-396c392bd72c:3635:1876371859265280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448113.559608:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859263360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448113.559666:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:502f2cd2-eb84-4c43-be93-396c392bd72c:3633:1876371859265408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448113.559701:0:3634:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f2d80 x1876371859266176/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448113.559702:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859265920:0@lo:9:umount.0 00000100:00100000:3.0:1789448113.559751:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859265792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448113.559757:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:502f2cd2-eb84-4c43-be93-396c392bd72c:3634:1876371859265664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448113.559786:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448113.559832:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859266048:0@lo:9:umount.0 00000100:00100000:2.0:1789448113.559855:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448113.559891:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859265920 00000100:00100000:2.0:1789448113.559893:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:502f2cd2-eb84-4c43-be93-396c392bd72c:3631:1876371859266176:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:3.0:1789448113.559902:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859265920 00000400:00000100:2.0:1789448113.559918:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876371859266176 offset 0 length 520: 4 00000100:00080000:2.0:1789448113.560405:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448113.560418:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859266048 00000100:00100000:3.0:1789448113.560424:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859266048 00000100:00100000:2.0:1789448113.560430:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789448113.560444:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1876371859265920:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789448113.560484:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789448113.560492:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1876371859266048:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789448113.560527:0:18694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3fe1 00000100:00080000:3.0:1789448113.560538:0:18694:0:(import.c:65:import_set_state_nolock()) ffff9516c77c2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789448113.560589:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789448113.560931:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3631:x1876371859266048:12345-0@lo:9:umount.0 Request processed in 438us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448113.560940:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789448113.560967:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789448113.561028:0:18692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3f47 00000100:00080000:2.0:1789448113.561037:0:18692:0:(import.c:65:import_set_state_nolock()) ffff9516c77c2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789448113.561154:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789448113.561264:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3631:x1876371859265920:12345-0@lo:9:umount.0 Request processed in 823us (1477us total) trans 0 rc 0/0 00010000:00010000:3.0:1789448113.561322:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448113.561343:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789448113.562128:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789448113.562325:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fd51a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789448113.562387:0:3631:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789448113.562473:0:3631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789448113.562481:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859265920:0@lo:9:umount.0 00000100:00080000:2.0:1789448113.562509:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c80b5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789448113.562521:0:3631:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789448113.562523:0:3631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789448113.562525:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859266048:0@lo:9:umount.0 00000001:00100000:2.0:1789448113.563887:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789448113.563898:0:18689:0:(genops.c:885:class_export_put()) final put ffff9516c77c4800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789448113.563928:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789448113.563932:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c77c4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789448113.563932:0:18689:0:(genops.c:885:class_export_put()) final put ffff9516c665a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789448113.564714:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c665a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789448113.564736:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c77c2800 for lustre-OST0000 00000020:00000080:3.0:1789448113.564740:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c6659000 for lustre-OST0000 00000400:00000100:0.0:1789448113.570699:0:17173:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876371859265280 offset 224 length 224: 4 00000100:00100000:0.0:1789448113.570734:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3635:x1876371859265280:12345-0@lo:103:ldlm_bl.0 Request processed in 26581us (26840us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789448113.570749:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00080000:2.0:1789448113.576969:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9517f80fcd40) has no exports 00010000:00010000:1.0:1789448113.589803:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789448113.610154:0:20956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517fd8d0ba0 - data ffff9517c4541360/ffff9517e7d89000 00000020:01000000:3.0:1789448113.610335:0:20956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517f81cf1e0 - data ffff9517c47b56c0/ffff9517df5a1800 00000001:00000004:3.0:1789448113.622945:0:20956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789448113.668786:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789448113.668793:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789448113.668800:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789448113.669992:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789448113.669998:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1789448113.670308:0:20956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448113.670312:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789448113.670754:0:17926:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789448113.670759:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789448113.670779:0:17926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789448113.671641:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789448113.671646:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1789448113.671692:0:20956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448113.671695:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789448113.672631:0:17928:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789448113.672636:0:17928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789448113.672645:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789448113.673904:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3ce6 00000020:00000080:3.0:1789448113.673914:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f77a4800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789448113.674121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789448113.674870:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3cfb 00000020:00000080:3.0:1789448113.674877:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f77a7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789448113.674893:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789448113.674898:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448113.674906:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789448113.674910:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9517f80f8000) has no exports 00000004:01000000:3.0:1789448113.675153:0:20956:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789448113.675161:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d4f 00000020:00000080:3.0:1789448113.675166:0:20956:0:(genops.c:885:class_export_put()) final put ffff9516c79ea800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789448113.675170:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789448113.675175:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448113.675179:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448113.675182:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9517f80f99c0) has no exports 00000020:00000080:3.0:1789448113.675187:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d48 00000020:00000080:3.0:1789448113.675191:0:20956:0:(genops.c:885:class_export_put()) final put ffff9516c80b2800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789448113.675542:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1789448113.675550:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c79ea800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789448113.675554:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c80b2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789448113.675737:0:20956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789448113.675742:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789448113.675746:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1789448113.675751:0:20956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448113.675758:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789448113.675827:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448113.675833:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789448113.675839:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d3a 00000020:00000080:3.0:1789448113.675845:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517d6719000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789448113.676590:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c80b5000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789448113.676600:0:8:0:(genops.c:885:class_export_put()) final put ffff9517d671c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789448113.676603:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d671c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789448113.676608:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789448113.676735:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789448113.676740:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448113.676746:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448113.676750:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9516c6730000) has no exports 00000020:00000080:3.0:1789448113.676756:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d33 00000020:00000080:3.0:1789448113.676760:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517fd51e000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789448113.677139:0:20956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789448113.677143:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789448113.677146:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1789448113.677150:0:20956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789448113.677152:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789448113.677179:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448113.677184:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789448113.677195:0:20956:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789448113.677200:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d1e 00000020:00000080:3.0:1789448113.677205:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f75c8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789448113.677218:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789448113.677222:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448113.677225:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448113.677227:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9516c6a3cd40) has no exports 00000020:00000080:3.0:1789448113.677231:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d17 00000020:00000080:3.0:1789448113.677233:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f75c9800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789448113.678383:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d6719000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789448113.678395:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fd51e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789448113.678402:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517fd51a000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789448113.678408:0:8:0:(genops.c:885:class_export_put()) final put ffff9517f80e2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789448113.678410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f80e2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789448113.678413:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789448113.678495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f75c8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789448113.678500:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f75c9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789448113.680544:0:20956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789448113.680553:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789448113.680557:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789448113.680564:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789448113.680614:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448113.680624:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789448113.680648:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448113.680651:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789448113.680656:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517ffd59000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789448113.680660:0:20956:0:(genops.c:844:class_export_destroy()) destroying export ffff9517ffd59000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789448113.680667:0:20956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789448113.680802:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d02 00000020:00000080:0.0:1789448113.680809:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f77a2800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789448113.680813:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789448113.680818:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448113.680822:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789448113.680825:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9517f80fb380) has no exports 00000020:00000080:0.0:1789448113.680843:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448113.680846:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789448113.680849:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d09 00000020:00000080:0.0:1789448113.680852:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f77a3800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789448113.680859:0:20956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9516c7a99800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789448113.680861:0:20956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9516c7a99800 2 00000020:01000004:0.0:1789448113.680864:0:20956:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9516c7a99800 from lustre-MDT0001 00000020:00000080:0.0:1789448113.680879:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448113.680882:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789448113.680884:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517f77a6800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789448113.680886:0:20956:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a6800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789448113.680892:0:20956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789448113.680929:0:20956:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789448113.680932:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789448113.680935:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448113.680939:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789448113.680945:0:20956:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9516c81f7000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789448113.680950:0:20956:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9516c6428000) has exports, disconnecting them 00000020:00080000:0.0:1789448113.680953:0:20956:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9516c81f7000), last request at 1789448039 00000020:00000080:0.0:1789448113.680957:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3d87 00000020:00080000:0.0:1789448113.680969:0:20956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c81f7000): rc 0 00000020:00000080:0.0:1789448113.680973:0:20956:0:(genops.c:885:class_export_put()) final put ffff9516c81f7000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789448113.681489:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517f75ca000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789448113.681496:0:8:0:(genops.c:885:class_export_put()) final put ffff9517f75cc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789448113.681499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f75cc000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789448113.681503:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789448113.681584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a2800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789448113.681588:0:8:0:(genops.c:885:class_export_put()) final put ffff9517f77a2000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789448113.681590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a2000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789448113.681592:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789448113.681680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f77a3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789448113.681685:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c81f7000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789448113.773534:0:20956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789448113.773542:0:20956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448113.773546:0:20956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789448113.773554:0:20956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448113.773863:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448113.773881:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789448113.773888:0:20956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9516c7a99800 1 00000020:00000080:1.0:1789448113.773894:0:20956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3cae 00000020:00000080:1.0:1789448113.773902:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517fda08800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789448113.773908:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789448113.773912:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448113.773916:0:20956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789448113.773920:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9517ca34b380) has no exports 00000020:00000080:3.0:1789448113.774671:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c7700000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789448113.774682:0:8:0:(genops.c:885:class_export_put()) final put ffff9516c7701800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789448113.774685:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7701800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789448113.774696:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789448113.774760:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517fda08800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789448113.868873:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448113.868885:0:20956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789448113.868890:0:20956:0:(genops.c:885:class_export_put()) final put ffff9516c7a9a800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789448113.868894:0:20956:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7a9a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789448113.868904:0:20956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789448113.869009:0:20956:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9516c7a9a000 00000020:01000000:1.0:1789448113.869027:0:20956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789448113.869031:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448113.869049:0:20956:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789448113.869053:0:20956:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9516c6a399c0) has no exports 00000100:00100000:2.0:1789448113.869338:0:18258:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9517fd714a00:18258] 3 exiting: rc = 0 00000100:00100000:2.0:1789448113.869421:0:17188:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9516c8283000:17188] 2 exiting: rc = 0 00000100:00100000:1.0:1789448113.869740:0:17187:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9516c1a49000:17187] 1 exiting: rc = 0 00000100:00100000:3.0:1789448113.874311:0:17186:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9516c8282000:17186] 0 exiting: rc = 1 00000100:00100000:0.0:1789448113.874754:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874762:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874768:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874772:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874778:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874782:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874788:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874795:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874801:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874806:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874812:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874819:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874824:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874829:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874835:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874841:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874846:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874851:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874858:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874864:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874869:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874874:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874880:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874902:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874908:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874914:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874919:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874925:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874930:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874937:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874943:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874948:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874953:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874959:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874964:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874969:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874974:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874979:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874984:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874990:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.874995:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875000:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875004:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875010:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875015:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875021:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875027:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875032:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875036:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875053:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875059:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875064:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875069:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875074:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875079:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875085:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875090:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875095:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875111:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875116:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875122:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875127:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875133:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.875139:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.884496:0:17189:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9516c8283c00:17189] 0 exiting: rc = 1 00000100:00100000:3.0:1789448113.885292:0:17190:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9516c1a48e00:17190] 1 exiting: rc = 0 00000100:00100000:0.0:1789448113.885829:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885841:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885847:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885853:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885859:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885864:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885869:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885874:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885879:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885884:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885889:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885894:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885899:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885904:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885909:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885914:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885918:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885923:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885927:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885932:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885937:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885941:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885946:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885950:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885955:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885959:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885964:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885969:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885974:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885990:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.885995:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886000:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886005:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886011:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886016:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886023:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886028:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886033:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886038:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886052:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886058:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886063:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886068:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886073:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886080:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886085:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886090:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886095:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886100:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886105:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886110:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886116:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886121:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886126:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886131:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886136:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886140:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886145:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886150:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886155:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886160:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886166:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886172:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.886177:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448113.893061:0:17191:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9517e0276000:17191] 0 exiting: rc = 1 00000100:00100000:3.0:1789448113.893167:0:18259:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9517fd549000:18259] 2 exiting: rc = 0 00000100:00100000:1.0:1789448113.899553:0:17192:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9517e025f000:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1789448113.899789:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899797:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899804:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899809:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899815:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899821:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899828:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899834:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899840:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899846:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899871:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899879:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899885:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899891:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899897:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899903:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899909:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899915:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899922:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899929:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899934:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899940:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899959:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899966:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899973:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899979:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899986:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899992:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.899998:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900004:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900011:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900019:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900026:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900032:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900060:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900081:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900087:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900094:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900099:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900105:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900111:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900118:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900125:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900133:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900141:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900149:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900169:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900178:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900184:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900190:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900196:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900201:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900207:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900213:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900234:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900242:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900248:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900254:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900276:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900284:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900289:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900296:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900302:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.900309:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915252:0:17193:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9517cc72d200:17193] 0 exiting: rc = 1 00000100:00100000:0.0:1789448113.915576:0:17194:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9516c83da600:17194] 1 exiting: rc = 0 00000100:00100000:2.0:1789448113.915768:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915775:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915780:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915784:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915789:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915794:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915800:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915805:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915810:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915815:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915820:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915840:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915845:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915850:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915855:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915860:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915865:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915871:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915876:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915881:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915886:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915890:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915894:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915899:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915903:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915908:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915913:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915917:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915921:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915926:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915931:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915936:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915940:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915945:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915950:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915954:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915959:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915964:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915969:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915974:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915979:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915983:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915988:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915993:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.915998:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916003:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916017:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916022:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916027:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916032:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916037:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916052:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916058:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916063:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916068:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916072:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916077:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916081:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916086:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916090:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916095:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916100:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916105:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.916111:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.916840:0:17195:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9516c83dac00:17195] 0 exiting: rc = 1 00000100:00100000:3.0:1789448113.917035:0:17196:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9516c7b19600:17196] 1 exiting: rc = 0 00000100:00100000:2.0:1789448113.917246:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917253:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917258:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917263:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917269:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917274:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917280:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917286:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917291:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917297:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917302:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917307:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917312:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917317:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917323:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917402:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917409:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917425:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917429:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917434:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917439:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917443:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917448:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917453:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917878:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917890:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917895:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917900:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917906:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917911:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917916:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917922:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917927:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917932:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917939:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917945:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917950:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917955:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917961:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917966:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917971:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917977:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917982:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917987:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917991:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.917997:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918002:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918007:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918013:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918018:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918023:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918027:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918054:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918060:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918065:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918070:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918076:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918081:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918086:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918091:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918096:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918102:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918107:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789448113.918113:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448113.918947:0:17198:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9516c7b19000:17198] 1 exiting: rc = 0 00000100:00100000:2.0:1789448113.919135:0:17197:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9516c7b19200:17197] 0 exiting: rc = 1 00000100:00100000:0.0:1789448113.919229:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919235:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919240:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919245:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919262:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919268:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919272:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919277:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919283:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919289:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919294:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919299:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919303:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919308:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919314:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919319:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919323:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919404:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919412:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919416:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919420:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919425:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919429:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919434:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919439:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919444:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919448:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919453:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919487:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919494:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919499:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919504:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919508:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919513:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919518:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919523:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919527:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919532:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919537:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919551:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919556:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919561:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919566:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919571:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919576:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919580:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919585:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919589:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919593:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919598:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919602:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919618:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919623:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919628:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919632:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919805:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919815:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919820:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919824:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919829:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919833:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919838:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919843:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.919849:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448113.920843:0:17200:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9517d4a18400:17200] 1 exiting: rc = 0 00000100:00100000:3.0:1789448113.921071:0:17201:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9517d4a18000:17201] 2 exiting: rc = 0 00000100:00100000:2.0:1789448113.921318:0:17199:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9517d4a18a00:17199] 0 exiting: rc = 1 00000100:00100000:0.0:1789448113.921708:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921719:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921725:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921731:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921737:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921766:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921773:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921779:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921785:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921791:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921810:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921815:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921821:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921827:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921834:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921840:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921846:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921851:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921857:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921863:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921869:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921875:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921881:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921886:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921891:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921897:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921902:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921907:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921913:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921937:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921944:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921950:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921955:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921960:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921965:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921970:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921975:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921980:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921985:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921990:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.921996:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922001:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922007:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922013:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922018:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922033:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922049:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922056:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922061:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922067:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922072:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922078:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922084:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922104:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922111:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922117:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922122:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922127:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922133:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922138:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922143:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922148:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922154:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789448113.922159:0:20956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789448113.930946:0:20956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789448113.930960:0:20956:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789448113.930965:0:20956:0:(genops.c:885:class_export_put()) final put ffff9517ffd70000/MDS_uuid 00000020:00000080:2.0:1789448113.930970:0:20956:0:(genops.c:844:class_export_destroy()) destroying export ffff9517ffd70000/MDS_uuid for MDS 00000020:01000000:2.0:1789448113.930975:0:20956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789448113.931131:0:20956:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789448114.616498:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448115.639343:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448116.661642:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448116.917613:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448116.917625:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448116.917629:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448116.917633:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789448116.917638:0:38:0:(import.c:65:import_set_state_nolock()) ffff9516c665d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448116.917646:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789448116.917651:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789448116.917664:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9516c665d000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448116.917705:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7411180 x1876371859266304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789448116.917791:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448116.917795:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789448116.917797:0:38:0:(import.c:65:import_set_state_nolock()) ffff9516c7924800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448116.917801:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1789448116.917804:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789448116.917809:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9516c7924800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448116.917822:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7410a80 x1876371859266560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448116.917858:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859266688:0@lo:400:kworker.0 00000100:00100000:3.0:1789448116.918113:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3631:1876371859266304:0@lo:38:kworker.0 00000400:00000100:2.0:1789448116.918145:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859266688 offset 0 length 224: 4 00000100:00100000:1.0:1789448116.918207:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859266432:0@lo:400:kworker.0 00000400:00000100:3.0:1789448116.923736:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859266304 offset 0 length 520: 4 00000100:00100000:3.0:1789448116.923777:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3631:1876371859266560:0@lo:38:kworker.0 00000400:00000100:3.0:1789448116.923802:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859266560 offset 0 length 520: 4 00000400:00000100:0.0:1789448116.929722:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859266432 offset 0 length 224: 4 00000020:01000004:0.0:1789448117.441107:0:21156:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789448117.451407:0:21156:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789448117.451481:0:21156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448117.451497:0:21156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448117.451504:0:21156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448117.451525:0:21156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448117.451542:0:21156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789448117.451547:0:21156:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789448117.451570:0:21156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448117.451580:0:21156:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7411180 x1876371859266304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789448131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448117.451599:0:21156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789448117.451604:0:21156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789448117.451609:0:21156:0:(import.c:65:import_set_state_nolock()) ffff9516c665d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789448117.451614:0:21156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448117.451621:0:21156:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7411180 x1876371859266304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789448131 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448117.451628:0:21156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789448117.451631:0:21156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1789448117.451994:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3631:1876371859266304:0@lo:38:kworker.0 00010000:00010000:3.0:1789448117.452318:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448117.452326:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448117.452335:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e200 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448117.452339:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448117.452357:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448117.452364:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448117.452384:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448117.452387:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789448117.452389:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789448117.452402:0:17174:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:3.0:1789448117.452407:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448117.452413:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b2e200/0x6522da1199ce3e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3e28 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448117.452425:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448117.452427:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448117.452428:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448117.454519:0:21156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789448117.454535:0:21156:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7410380 x1876371859266432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448117.455378:0:21156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789448117.455385:0:21156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789448117.455408:0:21156:0:(import.c:65:import_set_state_nolock()) ffff9516c665b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789448117.455497:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3631:1876371859266816:0@lo:39:umount.0 00000100:00100000:0.0:1789448117.455542:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859266432:0@lo:400:kworker.0 00000400:00000100:2.0:1789448117.455544:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859266816 offset 0 length 224: 4 00010000:00010000:3.0:1789448117.685681:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789448117.942479:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789448117.942488:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448117.942490:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789448117.942493:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448117.942595:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859266944:0@lo:400:kworker.0 00000400:00000100:1.0:1789448117.942660:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859266944 offset 0 length 224: 4 00010000:00010000:1.0:1789448118.709609:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789448119.490160:0:19506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789448119.490169:0:19506:0:(genops.c:885:class_export_put()) final put ffff9516c77c3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789448119.490253:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c77c3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789448119.490305:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c77c2000 for lustre-OST0001 00010000:00010000:3.0:1789448119.734217:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448120.757888:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448121.781613:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448121.973649:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448121.973695:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448121.973698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448121.973702:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448121.973814:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448121.977203:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859267072:0@lo:400:kworker.0 00000400:00000100:1.0:1789448121.977314:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859267072 offset 0 length 224: 4 00010000:00010000:3.0:1789448122.807086:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448123.637545:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448113/real 1789448113] req@ffff9516c82f2d80 x1876371859266176/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789448123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448123.637622:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9516c82f2d80 x1876371859266176/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789448123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789448123.637661:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448123.637686:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789448123.637691:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:502f2cd2-eb84-4c43-be93-396c392bd72c:3631:1876371859266176:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789448123.637960:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789448123.637966:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789448123.637968:0:38:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448123.637980:0:38:0:(import.c:545:import_select_connection()) MGC192.168.206.138@tcp: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1789448123.637985:0:38:0:(import.c:630:import_select_connection()) MGC192.168.206.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789448123.638005:0:38:0:(import.c:666:import_select_connection()) MGC192.168.206.138@tcp: import ffff9517f277e800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448123.638032:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f2300 x1876371859267200/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448123.638058:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789448123.638062:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448123.638167:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448123.638198:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859267328:0@lo:400:kworker.0 00000400:00000100:1.0:1789448123.638243:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859267328 offset 0 length 224: 4 00000100:00100000:2.0:1789448123.638610:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:502f2cd2-eb84-4c43-be93-396c392bd72c:3631:1876371859267200:0@lo:250:kworker.0 00000400:00000100:2.0:1789448123.638634:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876371859267200 offset 0 length 520: 4 00010000:00010000:3.0:1789448123.829695:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448124.853598:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448125.890385:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448126.901718:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448127.733584:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448117/real 1789448117] req@ffff9517fb9e1880 x1876371859266816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448127 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448127.733619:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517fb9e1880 x1876371859266816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448127 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789448127.733637:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c665b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789448127.733660:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3631:1876371859266816:0@lo:39:umount.0 00000100:00080000:1.0:1789448127.733753:0:21156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789448127.733757:0:21156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789448127.733762:0:21156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789448127.735131:0:21156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735148:0:21156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735155:0:21156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735161:0:21156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735271:0:21156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448127.735281:0:21156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735413:0:21156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735420:0:21156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448127.735425:0:21156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735808:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448127.735816:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735833:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d90eec00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448127.735837:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735844:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448127.735862:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448127.735867:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448127.735869:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789448127.735880:0:17939:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:0.0:1789448127.735884:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735889:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d90eec00/0x6522da1199ce3df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3dfe expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735904:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448127.735907:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735912:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a400 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448127.735914:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735920:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448127.735925:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448127.735930:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789448127.735932:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789448127.735934:0:17939:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:0.0:1789448127.735943:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448127.735949:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448127.735950:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448127.735952:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448127.742559:0:21156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789448127.742574:0:21156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d477a400/0x6522da1199ce415b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce4162 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448127.742596:0:21156:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789448127.742605:0:21156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789448127.742607:0:21156:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789448127.742638:0:21156:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789448127.742643:0:21156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789448127.742652:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448127.742657:0:21156:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789448127.742661:0:21156:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9516c642cd40) has no exports 00000020:00080000:1.0:1789448127.742682:0:21156:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9516c642cd40) has no exports 00010000:00010000:3.0:1789448127.743203:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789448127.748783:0:21156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517ecd83540 - data ffff9517ec847510/ffff9517df53c400 00000020:01000000:1.0:1789448127.749200:0:21156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9516c77dea20 - data ffff9517ecaf3360/ffff9516c6856800 00100000:10000000:1.0:1789448127.756217:0:21156:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789448127.768015:0:21156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3e0c 00000020:00000080:0.0:1789448127.768026:0:21156:0:(genops.c:885:class_export_put()) final put ffff9516c77c6800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789448127.768048:0:21156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517ca4b3800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789448127.768052:0:21156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517ca4b3800 2 00000020:01000004:0.0:1789448127.768055:0:21156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9517ca4b3800 from lustre-OST0000 00000020:00000080:0.0:1789448127.768077:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448127.768086:0:21156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789448127.768089:0:21156:0:(genops.c:885:class_export_put()) final put ffff9516c77c0000/lustre-OST0000_UUID 00000020:00000080:0.0:1789448127.768092:0:21156:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c77c0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789448127.768097:0:21156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789448127.768142:0:21156:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789448127.768145:0:21156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789448127.768148:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448127.768153:0:21156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789448127.768158:0:21156:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9516c665c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789448127.768163:0:21156:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9517ca34cd40) has exports, disconnecting them 00000020:00080000:0.0:1789448127.768167:0:21156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9516c665c800), last request at 1789448051 00000020:00000080:0.0:1789448127.768171:0:21156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3e36 00000020:00080000:0.0:1789448127.768216:0:21156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c665c800): rc 0 00000020:00000080:0.0:1789448127.768221:0:21156:0:(genops.c:885:class_export_put()) final put ffff9516c665c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789448127.768534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c77c6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789448127.768545:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c665c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789448127.769907:0:21156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789448127.769913:0:21156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789448127.769918:0:21156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789448127.769924:0:21156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448127.770101:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448127.770109:0:21156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789448127.770115:0:21156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789448127.770119:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448127.770123:0:21156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789448127.770129:0:21156:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9516c665f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789448127.770136:0:21156:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9517ca348000) has exports, disconnecting them 00000020:00080000:1.0:1789448127.770140:0:21156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9516c665f000), last request at 1789448051 00000020:00000080:1.0:1789448127.770143:0:21156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3e4b 00000020:00080000:1.0:1789448127.770157:0:21156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c665f000): rc 0 00000020:00000080:1.0:1789448127.770161:0:21156:0:(genops.c:885:class_export_put()) final put ffff9516c665f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789448127.770681:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c665d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789448127.770689:0:36:0:(genops.c:885:class_export_put()) final put ffff9516c665b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789448127.770694:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c665b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789448127.770699:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789448127.770752:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c665f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789448127.773338:0:21156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789448127.773346:0:21156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789448127.773350:0:21156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789448127.773357:0:21156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448127.773542:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448127.773550:0:21156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789448127.773556:0:21156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517ca4b3800 1 00000020:00000080:1.0:1789448127.773563:0:21156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3de9 00000020:00000080:1.0:1789448127.773571:0:21156:0:(genops.c:885:class_export_put()) final put ffff9517d3251800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789448127.773576:0:21156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789448127.773581:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448127.773585:0:21156:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789448127.773588:0:21156:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9516c6a3b380) has no exports 00000020:00000080:1.0:1789448127.777912:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c665b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789448127.777927:0:36:0:(genops.c:885:class_export_put()) final put ffff9516c665e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789448127.777931:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c665e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789448127.777942:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789448127.778170:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d3251800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789448127.816175:0:21156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448127.816196:0:21156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789448127.816201:0:21156:0:(genops.c:885:class_export_put()) final put ffff9517ca4b2800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789448127.816206:0:21156:0:(genops.c:844:class_export_destroy()) destroying export ffff9517ca4b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789448127.816219:0:21156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789448127.816475:0:21156:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9517ca4b1800 00000020:02000400:1.0:1789448127.816527:0:21156:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789448127.926719:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789448128.696252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789448128.696262:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448128.696265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789448128.696268:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448128.696329:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448128.696357:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3632:1876371859267456:0@lo:400:kworker.0 00000400:00000100:1.0:1789448128.696407:0:3632:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859267456 offset 0 length 224: 4 00010000:00010000:0.0:1789448128.950758:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448129.974570:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789448130.866838:0:21359:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789448130.879613:0:21359:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789448130.879696:0:21359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448130.879712:0:21359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448130.879719:0:21359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448130.879727:0:21359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448130.879776:0:21359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789448130.879782:0:21359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789448130.879809:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448130.879819:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7410a80 x1876371859266560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789448131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.879837:0:21359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789448130.879844:0:21359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789448130.879850:0:21359:0:(import.c:65:import_set_state_nolock()) ffff9516c7924800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789448130.879855:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789448130.879859:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7410a80 x1876371859266560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789448131 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.879865:0:21359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789448130.879868:0:21359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:3.0:1789448130.879933:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448130.879941:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448130.879948:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2f600 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448130.879952:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448130.879984:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448130.879992:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448130.880006:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448130.880008:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789448130.880011:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789448130.880024:0:17175:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:3.0:1789448130.880029:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448130.880036:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f600/0x6522da1199ce3f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3f8d expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448130.880047:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448130.880049:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448130.880051:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448130.880136:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3631:1876371859266560:0@lo:38:kworker.0 00000100:00080000:2.0:1789448130.881119:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789448130.881131:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7411880 x1876371859266688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.881151:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c82f2a00 x1876371859266944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.881161:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517e7411180 x1876371859267072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448137 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.881168:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c82f2680 x1876371859267328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448139 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.881175:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9517fb9e2d80 x1876371859267456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448130.881194:0:21359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789448130.881199:0:21359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789448130.881228:0:21359:0:(import.c:65:import_set_state_nolock()) ffff9516c680f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789448130.881356:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859267072:0@lo:400:kworker.0 00000100:00100000:3.0:1789448130.881365:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859266944:0@lo:400:kworker.0 00000100:00100000:0.0:1789448130.881449:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3632:1876371859267456:0@lo:400:kworker.0 00000100:00100000:0.0:1789448130.881513:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3631:1876371859267584:0@lo:39:umount.0 00000400:00000100:0.0:1789448130.881554:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876371859267584 offset 0 length 224: 4 00000100:00100000:1.0:1789448130.881809:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859267328:0@lo:400:kworker.0 00000100:00100000:1.0:1789448130.881823:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859266688:0@lo:400:kworker.0 00010000:00010000:0.0:1789448130.997806:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448132.022598:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448133.045687:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448133.813628:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789448133.813637:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789448134.071336:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448135.096499:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448136.117677:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448137.142303:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448138.038114:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448123/real 1789448123] req@ffff9516c82f2300 x1876371859267200/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789448138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448138.038150:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9516c82f2300 x1876371859267200/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789448138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789448138.038168:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789448138.038200:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789448138.038204:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:502f2cd2-eb84-4c43-be93-396c392bd72c:3631:1876371859267200:0@lo:250:kworker.0 00000100:00080000:0.0:1789448138.038303:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789448138.038309:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789448138.038312:0:38:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448138.038317:0:38:0:(import.c:545:import_select_connection()) MGC192.168.206.138@tcp: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1789448138.038321:0:38:0:(import.c:630:import_select_connection()) MGC192.168.206.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789448138.038332:0:38:0:(import.c:666:import_select_connection()) MGC192.168.206.138@tcp: import ffff9517f277e800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448138.038361:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770d180 x1876371859267712/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789448138.041518:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:502f2cd2-eb84-4c43-be93-396c392bd72c:3631:1876371859267712:0@lo:250:kworker.0 00000400:00000100:1.0:1789448138.041592:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876371859267712 offset 0 length 520: 4 00010000:00010000:3.0:1789448138.165742:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448139.189746:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448140.085606:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448130/real 1789448130] req@ffff9517e7413800 x1876371859267584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448140 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448140.085644:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517e7413800 x1876371859267584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789448140 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789448140.085682:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c680f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789448140.085704:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3631:1876371859267584:0@lo:39:umount.0 00000100:00080000:2.0:1789448140.086014:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789448140.086018:0:21359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789448140.086023:0:21359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789448140.087220:0:21359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087235:0:21359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087242:0:21359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087249:0:21359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087277:0:21359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448140.087285:0:21359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087292:0:21359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087298:0:21359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087304:0:21359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448140.087401:0:21359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789448140.087404:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1789448140.087407:0:21359:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1789448140.087413:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087423:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8009600 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448140.087427:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789448140.087433:0:21359:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1789448140.087437:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789448140.087438:0:21359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789448140.087446:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:0.0:1789448140.087448:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789448140.087453:0:21359:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789448140.087482:0:21359:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9517f9390000) has no exports 10000000:01000000:0.0:1789448140.087492:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789448140.087503:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789448140.087506:0:17939:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:2.0:1789448140.087507:0:21359:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9517f9390000) has no exports 00010000:00010000:0.0:1789448140.087521:0:17939:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:0.0:1789448140.087527:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087534:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce3f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3f63 expref: -99 pid: 19505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087547:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448140.087551:0:17939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087557:0:17939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2f800 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448140.087559:0:17939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087566:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448140.087585:0:17939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448140.087591:0:17939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789448140.087593:0:17939:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789448140.087595:0:17939:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789448140.087600:0:17939:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:0.0:1789448140.087603:0:17939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087609:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b2f800/0x6522da1199ce414d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce4154 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448140.087629:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448140.087631:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448140.087633:0:17939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448140.093952:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789448140.094136:0:21359:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517ecd839c0 - data ffff9517eca8d948/ffff9516c5ba4c00 00000020:01000000:2.0:1789448140.094397:0:21359:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9517ecd834e0 - data ffff9517c474b0d8/ffff9516c5ba7800 00100000:10000000:2.0:1789448140.103215:0:21359:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789448140.109368:0:21359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3f71 00000020:00000080:3.0:1789448140.109379:0:21359:0:(genops.c:885:class_export_put()) final put ffff9517f2768000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789448140.109401:0:21359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9516c665e000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789448140.109404:0:21359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9516c665e000 2 00000020:01000004:3.0:1789448140.109407:0:21359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9516c665e000 from lustre-OST0001 00000020:00000080:3.0:1789448140.109443:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448140.109452:0:21359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789448140.109455:0:21359:0:(genops.c:885:class_export_put()) final put ffff9517e1572800/lustre-OST0001_UUID 00000020:00000080:3.0:1789448140.109490:0:21359:0:(genops.c:844:class_export_destroy()) destroying export ffff9517e1572800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789448140.109499:0:21359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789448140.109601:0:21359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 502f2cd2-eb84-4c43-be93-396c392bd72c->MGS 00010000:00010000:3.0:1789448140.109616:0:21359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce3cb5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3cbc expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448140.109626:0:21359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce3cb5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3cbc expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448140.109633:0:21359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789448140.109635:0:21359:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789448140.109638:0:21359:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789448140.109649:0:21359:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:3.0:1789448140.109653:0:21359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce3cb5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3cbc expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448140.109666:0:21359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce3ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6522da1199ce3bab expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448140.109673:0:21359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce3ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6522da1199ce3bab expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448140.109677:0:21359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789448140.109679:0:21359:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789448140.109688:0:21359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789448140.109698:0:21359:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9517f277e800 00010000:00010000:3.0:1789448140.109700:0:21359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce3ba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6522da1199ce3bab expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789448140.109713:0:21359:0:(import.c:65:import_set_state_nolock()) ffff9517f277e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789448140.109717:0:21359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789448140.109719:0:21359:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789448140.109721:0:21359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789448140.109724:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789448140.109733:0:21359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9516c770d180 x1876371859267712/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789448158 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789448140.109744:0:21359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789448140.109746:0:21359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1789448140.109896:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:502f2cd2-eb84-4c43-be93-396c392bd72c:3631:1876371859267712:0@lo:250:kworker.0 00000020:00000080:0.0:1789448140.110096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f2768000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1789448140.110142:0:21359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789448140.110148:0:21359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3b8f 00000020:00000080:3.0:1789448140.110153:0:21359:0:(genops.c:885:class_export_put()) final put ffff9517ffd74800/502f2cd2-eb84-4c43-be93-396c392bd72c 00000020:01000000:3.0:1789448140.110207:0:21359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.138@tcp (flags='') 00000020:00000080:3.0:1789448140.110212:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448140.110217:0:21359:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789448140.110220:0:21359:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9516c76e8000) has no exports 10000000:01000000:1.0:1789448140.110401:0:17184:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789448140.111093:0:21359:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.138@tcp: client import never connected 00000100:00080000:3.0:1789448140.111098:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789448140.111101:0:21359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789448140.111104:0:21359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789448140.111106:0:21359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789448140.111157:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517ffd74800/502f2cd2-eb84-4c43-be93-396c392bd72c for MGC192.168.206.138@tcp 00000020:00000080:3.0:1789448140.111889:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789448140.111898:0:21359:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.138@tcp (uuid 502f2cd2-eb84-4c43-be93-396c392bd72c) 00000020:01000000:3.0:1789448140.111905:0:21359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789448140.111908:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789448140.111913:0:21359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789448140.111933:0:21359:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9516c7925000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789448140.111968:0:21359:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9516c79099c0) has exports, disconnecting them 00000020:00080000:3.0:1789448140.111973:0:21359:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9516c7925000), last request at 1789448065 00000020:00000080:3.0:1789448140.111978:0:21359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3f9b 00000020:00080000:3.0:1789448140.111991:0:21359:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c7925000): rc 0 00000020:00000080:3.0:1789448140.111995:0:21359:0:(genops.c:885:class_export_put()) final put ffff9516c7925000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789448140.112959:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9517f277e800 for MGC192.168.206.138@tcp 00000020:00000080:0.0:1789448140.112972:0:8:0:(genops.c:885:class_export_put()) final put ffff9517cc7db000/502f2cd2-eb84-4c43-be93-396c392bd72c 00000020:00000080:0.0:1789448140.112975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517cc7db000/502f2cd2-eb84-4c43-be93-396c392bd72c for MGC192.168.206.138@tcp 00000020:01000000:0.0:1789448140.112981:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.138@tcp (502f2cd2-eb84-4c43-be93-396c392bd72c) 00000020:00000080:0.0:1789448140.113245:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7925000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789448140.115552:0:21359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789448140.115560:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789448140.115564:0:21359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789448140.115571:0:21359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789448140.115739:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789448140.115747:0:21359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789448140.115754:0:21359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789448140.115759:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789448140.115763:0:21359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789448140.115769:0:21359:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9516c680d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789448140.115775:0:21359:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9516c790b380) has exports, disconnecting them 00000020:00080000:0.0:1789448140.115779:0:21359:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9516c680d800), last request at 1789448065 00000020:00000080:0.0:1789448140.115783:0:21359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3fb0 00000020:00080000:0.0:1789448140.115797:0:21359:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9516c680d800): rc 0 00000020:00000080:0.0:1789448140.115802:0:21359:0:(genops.c:885:class_export_put()) final put ffff9516c680d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789448140.116426:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c7924800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789448140.116434:0:8:0:(genops.c:885:class_export_put()) final put ffff9516c7922000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789448140.116436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7922000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789448140.116447:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789448140.116536:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c680d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789448140.116567:0:21359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789448140.116571:0:21359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789448140.116574:0:21359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789448140.116578:0:21359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789448140.116593:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9516c680f000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789448140.116638:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789448140.116756:0:17939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789448140.116831:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789448140.116912:0:17169:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9516c770be00:17169] 0 exiting: rc = 1 00000100:00100000:1.0:1789448140.116992:0:17170:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9516c6714e00:17170] 1 exiting: rc = 0 00000100:00100000:1.0:1789448140.117046:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117260:0:17173:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9516c6715000:17173] 2 exiting: rc = 0 00000100:00100000:1.0:1789448140.117330:0:17171:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9516c6715600:17171] 0 exiting: rc = 1 00000100:00100000:1.0:1789448140.117399:0:18340:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9517f7742600:18340] 3 exiting: rc = 0 00000100:00100000:1.0:1789448140.117489:0:17172:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9516c6714200:17172] 1 exiting: rc = 0 00000100:00100000:1.0:1789448140.117567:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117574:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117583:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117588:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117593:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117599:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117604:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117610:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117618:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117623:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117628:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117632:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117637:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117643:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117648:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117654:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117659:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117663:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117668:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117674:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117679:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117685:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117690:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117695:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117702:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117707:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117713:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117718:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117723:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117728:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117732:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117737:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117742:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117755:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117760:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117764:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117769:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117775:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117781:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117786:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117791:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117796:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117801:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117805:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117811:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117815:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117821:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117826:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117831:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117836:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117841:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117846:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117851:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117857:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117862:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117868:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117873:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117879:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117884:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117889:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117894:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117899:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117904:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.117909:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789448140.118502:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448140.118511:0:21359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789448140.118515:0:21359:0:(genops.c:885:class_export_put()) final put ffff9516c7926000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789448140.118518:0:21359:0:(genops.c:844:class_export_destroy()) destroying export ffff9516c7926000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789448140.118528:0:21359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789448140.118565:0:21359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9516c665e000 1 00000020:00000080:1.0:1789448140.118571:0:21359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6522da1199ce3f55 00000020:00000080:1.0:1789448140.118577:0:21359:0:(genops.c:885:class_export_put()) final put ffff9517e7d81800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789448140.118587:0:21359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789448140.118595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9517e7d81800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789448140.118605:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448140.118610:0:21359:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789448140.118614:0:21359:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9516c7908000) has no exports 00000020:00000080:1.0:1789448140.144406:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448140.144419:0:21359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789448140.144424:0:21359:0:(genops.c:885:class_export_put()) final put ffff9517f75ca800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789448140.144429:0:21359:0:(genops.c:844:class_export_destroy()) destroying export ffff9517f75ca800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789448140.144439:0:21359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789448140.144741:0:21359:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9516c665f800 00000020:01000000:1.0:1789448140.144760:0:21359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789448140.144765:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789448140.144769:0:21359:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789448140.144772:0:21359:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9516c67319c0) has no exports 00000020:00000080:1.0:1789448140.144792:0:21359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789448140.144796:0:21359:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789448140.144799:0:21359:0:(genops.c:885:class_export_put()) final put ffff9517d3250000/OSS_uuid 00000020:00000080:1.0:1789448140.144801:0:21359:0:(genops.c:844:class_export_destroy()) destroying export ffff9517d3250000/OSS_uuid for OSS 00000020:01000000:1.0:1789448140.144805:0:21359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789448140.144872:0:19002:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9516c8876e00:19002] 3 exiting: rc = 0 00000100:00080000:3.0:1789448140.145087:0:17182:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789448140.145564:0:18693:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9516c8095800:18693] 1 exiting: rc = 0 00000100:00100000:3.0:1789448140.145618:0:18692:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9516c812fc00:18692] 0 exiting: rc = 1 00000100:00100000:3.0:1789448140.145667:0:18694:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9517df47de00:18694] 2 exiting: rc = 0 00000100:00100000:1.0:1789448140.145761:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145769:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145774:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145779:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145785:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145790:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145795:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145814:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145820:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145825:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145830:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145836:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145841:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145845:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145850:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145855:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145859:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145864:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145869:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145874:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145880:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145885:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145889:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145894:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145899:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145904:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145909:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145926:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145932:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145937:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145942:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145947:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.145952:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146030:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146035:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146039:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146044:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146049:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146054:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146058:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146063:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146068:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146081:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146086:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146091:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146095:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146099:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146104:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146108:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146112:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146117:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146122:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146128:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146134:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146139:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146145:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146150:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146155:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146160:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146165:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146169:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146174:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146179:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.146323:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.147761:0:18697:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9517ec319400:18697] 1 exiting: rc = 0 00000100:00100000:3.0:1789448140.147847:0:20323:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9516c6aa9e00:20323] 2 exiting: rc = 0 00000100:00100000:0.0:1789448140.148220:0:18696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9516c7708400:18696] 0 exiting: rc = 1 00000100:00100000:1.0:1789448140.148504:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148511:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148516:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148546:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148565:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148571:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148577:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148581:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148586:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148591:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148596:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148601:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148605:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148618:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148623:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148627:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148632:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148637:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148643:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148649:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148655:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148660:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148665:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148671:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148676:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148680:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148685:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148690:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148696:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148701:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148707:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148711:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148716:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148721:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148726:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148731:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148735:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148741:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148745:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148751:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148755:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148760:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148766:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148771:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148775:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148780:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148786:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148790:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148805:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148811:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148816:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148821:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148826:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148831:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148836:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148840:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148845:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148851:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148855:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148860:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148864:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148869:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148874:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.148879:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.150530:0:18699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9516c5bf8400:18699] 1 exiting: rc = 0 00000100:00100000:3.0:1789448140.150682:0:18698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9517ec318400:18698] 0 exiting: rc = 1 00000100:00100000:1.0:1789448140.150889:0:18700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9517cb8a1000:18700] 2 exiting: rc = 0 00000100:00100000:3.0:1789448140.151197:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151207:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151213:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151218:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151225:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151231:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151359:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151365:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151373:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151379:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151385:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151391:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151396:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151402:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151408:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151413:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151418:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151424:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151440:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151445:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151451:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151456:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151492:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151497:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151502:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151523:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151530:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151535:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151541:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151546:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151552:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151558:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151562:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151568:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151573:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151592:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151598:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151603:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151608:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151613:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151619:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151624:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151629:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151635:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151640:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151645:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151650:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151655:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151660:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151679:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151686:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151691:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151696:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151707:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151712:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151718:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151723:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151736:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151743:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151748:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151754:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151759:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151765:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.151770:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.160125:0:18701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9517cb8a0000:18701] 0 exiting: rc = 1 00000100:00100000:0.0:1789448140.160450:0:18702:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9517cb8a0c00:18702] 1 exiting: rc = 0 00000100:00100000:1.0:1789448140.160684:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160691:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160695:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160701:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160707:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160712:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160718:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160725:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160730:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160734:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160740:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160745:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160750:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160755:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160759:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160764:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160769:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160774:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160792:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160797:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160802:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160808:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160813:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160818:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160823:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160828:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160833:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160838:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160844:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160849:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160854:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160859:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160864:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160869:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160874:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160879:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160884:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160890:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160896:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160901:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160906:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160912:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160934:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.160951:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161027:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161033:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161039:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161044:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161050:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161055:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161060:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161065:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161071:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161083:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161089:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161094:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161100:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161105:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161111:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161117:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161122:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161128:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161133:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.161138:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789448140.167064:0:18703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9517df6f7e00:18703] 0 exiting: rc = 1 00000100:00100000:3.0:1789448140.167587:0:18704:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9517df6f6e00:18704] 1 exiting: rc = 0 00000100:00100000:1.0:1789448140.167704:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167712:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167727:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167735:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167740:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167746:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167752:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167776:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167783:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167788:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167794:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167800:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167806:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167812:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167818:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167824:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167829:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167835:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167841:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167861:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167868:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167874:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167880:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167886:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167904:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167910:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167926:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167933:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167939:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167945:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167951:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167976:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167983:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167989:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.167995:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168002:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168008:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168014:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168021:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168027:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168033:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168038:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168044:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168065:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168072:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168078:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168084:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168089:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168095:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168101:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168107:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168113:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168119:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168125:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168131:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168151:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168158:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168164:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168169:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168196:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168202:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168207:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168213:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789448140.168226:0:21359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789448140.178872:0:21359:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789448156.979266:0:22124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg638-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789448167.829092:0:22724:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789448167.829098:0:22724:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789448167.829105:0:22724:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789448167.829208:0:22724:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9517fb910000 00000020:01000004:0.0:1789448167.829221:0:22724:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789448167.829227:0:22724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789448167.829239:0:22724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9516c67319c0) 00000020:00000080:0.0:1789448167.829251:0:22724:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789448167.931348:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789448167.933003:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789448167.937154:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789448167.940033:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.941733:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.942751:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.943743:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.944839:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.945394:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.946003:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.947199:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.947529:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.947982:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.948761:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.950995:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.952738:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.953205:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.953913:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.954316:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.954777:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.955959:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.957724:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.959237:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.959933:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.960981:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.961430:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.962186:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.962426:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.962926:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.964986:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.965918:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.966246:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.966445:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.967036:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789448167.968012:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789448167.970063:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.970773:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789448167.971821:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.972071:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789448167.975340:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.976251:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789448167.976579:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789448167.976798:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.977009:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.977382:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.977701:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789448167.978856:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789448167.979964:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.987025:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.987630:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.988245:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.988526:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789448167.988759:0:22724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1789448167.989241:0:22724:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789448167.989720:0:22724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789448167.989728:0:22724:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789448167.989837:0:22724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce4495 00000020:01000004:0.0:1789448167.989845:0:22724:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789448167.989850:0:22724:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789448167.989856:0:22724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9517fb910000 from MGS 00000020:01000004:0.0:1789448167.989859:0:22724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789448167.989868:0:22724:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9516c6730000) 00000020:00000080:0.0:1789448167.989878:0:22724:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789448167.989941:0:22724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517fb910000 from MGS, refs=2 00080000:01000000:0.0:1789448167.989945:0:22724:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789448167.989949:0:22724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce44a3 00000100:00100000:0.0:1789448167.990046:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789448167.990177:0:22724:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789448167.990183:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789448167.990851:0:22724:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789448167.990860:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789448167.991556:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448167.991778:0:22724:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789448167.991794:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789448167.999404:0:22724:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789448167.999417:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789448167.999951:0:22724:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789448167.999957:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789448168.001428:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448168.001432:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448168.001433:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448168.002028:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448168.002031:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448168.002033:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448168.002550:0:22724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789448168.017708:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789448168.026995:0:22724:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789448168.036351:0:22736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789448168.036419:0:22724:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789448168.036499:0:22724:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789448168.037156:0:22724:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789448168.037457:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448168.039700:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789448168.039707:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789448168.045861:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789448168.045876:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789448168.051199:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789448168.051212:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789448168.052007:0:22724:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789448168.052025:0:22724:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.138@tcp' 00000020:01000004:0.0:1789448168.052027:0:22724:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789448168.052060:0:22724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.138@tcp (typ=mgc) 00000020:00000080:0.0:1789448168.052071:0:22724:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.138@tcp (ffff9516c6734d40) 00000020:00000080:0.0:1789448168.052084:0:22724:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1789448168.052211:0:22741:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1789448168.055709:0:22724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9516c79ed800@MGC192.168.206.138@tcp: add connection 192.168.206.138@tcp at head 00010000:00010000:0.0:1789448168.055876:0:22724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.138@tcp-0 is initialized 00000040:01000000:0.0:1789448168.055882:0:22724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.138@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789448168.060204:0:22742:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789448168.061311:0:22724:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.138@tcp (uuid 562d8d7b-adf5-44cc-8730-f8665ac1447a) 00000020:00000080:2.0:1789448168.061338:0:22724:0:(genops.c:1384:class_connect()) connect: client 562d8d7b-adf5-44cc-8730-f8665ac1447a, cookie 0x6522da1199ce44b1 00000100:00080000:2.0:1789448168.061349:0:22724:0:(import.c:545:import_select_connection()) MGC192.168.206.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789448168.061362:0:22724:0:(import.c:666:import_select_connection()) MGC192.168.206.138@tcp: import ffff9516c79ed800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448168.061391:0:22724:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7411c00 x1876371859267840/t0(0) o250->MGC192.168.206.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789448168.061420:0:22724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 562d8d7b-adf5-44cc-8730-f8665ac1447a->MGS 00000020:01000004:2.0:1789448168.061476:0:22724:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789448168.061480:0:22724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789448168.061494:0:22724:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9516c790cd40) 00000020:00000080:2.0:1789448168.061505:0:22724:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789448168.062366:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:562d8d7b-adf5-44cc-8730-f8665ac1447a:3631:1876371859267840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789448168.062425:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448168.062508:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859267840 00000100:00100000:1.0:1789448168.062515:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859267840 00000100:00100000:1.0:1789448168.062545:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448168.062551:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c69d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3631:x1876371859267840:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789448168.062573:0:22739:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 562d8d7b-adf5-44cc-8730-f8665ac1447a@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:1.0:1789448168.062596:0:22739:0:(genops.c:1384:class_connect()) connect: client 562d8d7b-adf5-44cc-8730-f8665ac1447a, cookie 0x6522da1199ce44bf 00000100:00080000:1.0:1789448168.062711:0:22739:0:(import.c:65:import_set_state_nolock()) ffff9517fb8be000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448168.062757:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c69d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+5:3631:x1876371859267840:12345-0@lo:250:mount.lustre.0 Request processed in 204us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.062764:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448168.062814:0:3631:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789448168.062822:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.138@tcp: connect to target with instance 0 00000100:00080000:1.0:1789448168.062829:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789448168.062832:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789448168.062835:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c79ed800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789448168.062837:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789448168.062844:0:3631:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789448168.062849:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:562d8d7b-adf5-44cc-8730-f8665ac1447a:3631:1876371859267840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789448168.088889:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448168.089815:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789448168.089822:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789448168.097025:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789448168.097040:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789448168.097518:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789448168.097526:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789448168.098540:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448168.098699:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789448168.098705:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789448168.100039:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789448168.100049:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789448168.150390:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448168.150606:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789448168.150612:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789448168.152863:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789448168.152876:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789448168.154118:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448168.154289:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789448168.154295:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789448168.155957:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789448168.155967:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789448168.156738:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448168.156904:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789448168.156910:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789448168.158228:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789448168.158237:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789448168.159096:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448168.159257:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789448168.159262:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789448168.160207:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789448168.160215:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789448168.184759:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448168.184951:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789448168.184957:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789448168.186282:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789448168.186293:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789448168.187122:0:22724:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789448168.187131:0:22724:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789448168.187996:0:22724:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789448168.188024:0:22724:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789448168.188030:0:22724:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789448168.188137:0:22724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789448168.188175:0:22724:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.138@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789448168.188180:0:22724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789448168.188181:0:22724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789448168.188186:0:22724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448168.188187:0:22724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448168.188188:0:22724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448168.188189:0:22724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448168.188190:0:22724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789448168.188191:0:22724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789448168.188193:0:22724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448168.188194:0:22724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448168.188197:0:22724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789448168.188199:0:22724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448168.188200:0:22724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789448168.188201:0:22724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448168.188202:0:22724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448168.188202:0:22724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448168.188203:0:22724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448168.188204:0:22724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789448168.188205:0:22724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789448168.188206:0:22724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448168.188207:0:22724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789448168.188228:0:22724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789448168.188246:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859267968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789448168.188310:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.188348:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c68b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448168.188488:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859267968 00000100:00100000:0.0:1789448168.188496:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859267968 00000100:00100000:0.0:1789448168.188535:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448168.188544:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c69d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+5:22724:x1876371859267968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789448168.188587:0:22740:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789448168.188590:0:22740:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789448168.188593:0:22740:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789448168.189205:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789448168.190045:0:22740:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1789448168.191648:0:22761:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789448168.191655:0:22761:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789448168.191658:0:22761:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789448168.191661:0:22761:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789448168.191877:0:22761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789448168.192061:0:22740:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789448168.192071:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789448168.193408:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c69d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+5:22724:x1876371859267968:12345-0@lo:253:mount.lustre.0 Request processed in 4857us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.193424:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448168.193593:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859267968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789448168.193607:0:22724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789448168.193610:0:22724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448168.193611:0:22724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448168.193613:0:22724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448168.193614:0:22724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448168.193615:0:22724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448168.193617:0:22724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448168.193618:0:22724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448168.193619:0:22724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448168.193628:0:22724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448168.193630:0:22724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789448168.193645:0:22724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9517fb910000 from lustre-MDT0000 10000000:01000000:0.0:1789448168.193671:0:22724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789448168.193674:0:22724:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789448168.193678:0:22724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9516c6734d40 10000000:01000000:0.0:1789448168.193682:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448168.193689:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9516c6734d40 from 1 10000000:01000000:0.0:1789448168.193692:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789448168.193723:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.193734:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.193743:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.193761:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448168.193804:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.193838:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448168.193882:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268096 00000100:00100000:1.0:1789448168.193889:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268096 00000100:00100000:1.0:1789448168.193919:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448168.193927:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+5:22724:x1876371859268096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448168.193937:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448168.193949:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90ef800/0x6522da1199ce44cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce44c6 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.193970:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ef800/0x6522da1199ce44cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce44c6 expref: 6 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.193992:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90ef800/0x6522da1199ce44cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce44c6 expref: 6 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.194000:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ef800, rc 0) 00000100:00100000:1.0:1789448168.194039:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+6:22724:x1876371859268096:12345-0@lo:101:mount.lustre.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.194045:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448168.194111:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448168.194125:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.194133:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.194178:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448168.194201:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.194238:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448168.194298:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268224 00000100:00100000:3.0:1789448168.194302:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268224 00000100:00100000:3.0:1789448168.194332:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448168.194339:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+6:22724:x1876371859268224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448168.194408:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+6:22724:x1876371859268224:12345-0@lo:501:mount.lustre.0 Request processed in 70us (206us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448168.194415:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448168.194586:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268224:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789448168.194611:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789448168.194629:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.194638:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448168.194644:0:22724:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9517fb910000 10000000:01000000:0.0:1789448168.194648:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789448168.194652:0:22724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9517fb910000 10000000:01000000:0.0:1789448168.194654:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789448168.194657:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9517fb910000 from 1 10000000:01000000:0.0:1789448168.194659:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789448168.194672:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.194679:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.194686:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.194697:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448168.194719:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.194744:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448168.194795:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268352 00000100:00100000:3.0:1789448168.194799:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268352 00000100:00100000:3.0:1789448168.194830:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448168.194836:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+6:22724:x1876371859268352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448168.194851:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448168.194861:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477b400/0x6522da1199ce44db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce44d4 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.194874:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477b400/0x6522da1199ce44db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce44d4 expref: 7 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.194882:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477b400/0x6522da1199ce44db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce44d4 expref: 7 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.194888:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477b400, rc 0) 00000100:00100000:3.0:1789448168.194913:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+7:22724:x1876371859268352:12345-0@lo:101:mount.lustre.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448168.194919:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448168.195055:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448168.195066:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44db expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.195079:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce44db expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448168.195089:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789448168.195104:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44db expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.195111:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75f600/0x6522da1199ce44d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44db expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448168.195117:0:22724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789448168.195121:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448168.195125:0:22724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9517fb910000 10000000:01000000:0.0:1789448168.195127:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789448168.195130:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789448168.195132:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789448168.195145:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.195152:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.195159:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.195170:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448168.195196:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.195253:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448168.198412:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268480 00000100:00100000:3.0:1789448168.198426:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268480 00000100:00100000:3.0:1789448168.198504:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448168.198515:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+7:22724:x1876371859268480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448168.198532:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448168.198549:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477be00/0x6522da1199ce44e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce44e2 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.198574:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477be00/0x6522da1199ce44e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce44e2 expref: 8 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.198584:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477be00/0x6522da1199ce44e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce44e2 expref: 8 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.198591:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477be00, rc 0) 00000100:00100000:3.0:1789448168.198670:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+8:22724:x1876371859268480:12345-0@lo:101:mount.lustre.0 Request processed in 158us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448168.198677:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448168.198885:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448168.198918:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44e9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.198934:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce44e9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.199004:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448168.199042:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.199075:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448168.199133:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268608 00000100:00100000:1.0:1789448168.199137:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268608 00000100:00100000:1.0:1789448168.199169:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448168.199177:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+8:22724:x1876371859268608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448168.199305:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22724:x1876371859268608:12345-0@lo:501:mount.lustre.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.199313:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448168.199445:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448168.199501:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448168.199539:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.199565:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.199614:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268736 00000100:00100000:2.0:1789448168.199619:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268736 00000100:00100000:2.0:1789448168.199641:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448168.199648:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517dab15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22724:x1876371859268736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448168.200321:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517dab15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22724:x1876371859268736:12345-0@lo:503:mount.lustre.0 Request processed in 671us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.200340:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448168.200490:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859268736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448168.201032:0:22762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22762:1876371859268864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448168.201070:0:22762:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.201110:0:22762:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d34190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.201205:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268864 00000100:00100000:2.0:1789448168.201210:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268864 00000100:00100000:2.0:1789448168.201246:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448168.201254:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22762:x1876371859268864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448168.201900:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22762:x1876371859268864:12345-0@lo:502:llog_process_th.0 Request processed in 644us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.201909:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789448168.201992:0:22762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22762:1876371859268864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789448168.202019:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448168.202029:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.202032:0:22762:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789448168.202037:0:22762:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789448168.202040:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448168.202052:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9516c6733380) 00000020:00000080:0.0:1789448168.202068:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789448168.202079:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789448168.202164:0:22762:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789448168.202172:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce44f7 00000020:00000080:0.0:1789448168.202358:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789448168.202365:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448168.202368:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.202369:0:22762:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789448168.202372:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448168.202375:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.202376:0:22762:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789448168.202379:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448168.202387:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9516c6a3b380) 00000020:00000080:0.0:1789448168.202396:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789448168.202400:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789448168.202402:0:22762:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789448168.202405:0:22762:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789448168.202410:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789448168.202453:0:22762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517fb910000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789448168.202634:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9516c6a399c0) 00000020:00000080:0.0:1789448168.202643:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789448168.202708:0:22762:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789448168.202714:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce450c 00000020:00000080:0.0:1789448168.202811:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789448168.202817:0:22762:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789448168.202821:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6522da1199ce4513 00080000:01000000:0.0:1789448168.202826:0:22762:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789448168.202830:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce451a 00010000:00010000:0.0:1789448168.272204:0:22762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789448168.272797:0:22762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:0.0:1789448168.273186:0:22762:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789448168.273748:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9516c6a3cd40) 00000020:00000080:0.0:1789448168.273766:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789448168.273845:0:22762:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789448168.273859:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce4528 00000020:00000080:1.0:1789448168.275190:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789448168.279256:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6522da1199ce452f 00000020:00000080:2.0:1789448168.282585:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789448168.282599:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448168.282607:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448168.282609:0:22762:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789448168.282613:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789448168.282616:0:22762:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789448168.282618:0:22762:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789448168.282619:0:22762:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789448168.282620:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789448168.282623:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448168.282624:0:22762:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789448168.282627:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448168.282631:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448168.282633:0:22762:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789448168.282637:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789448168.282684:0:22762:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789448168.282700:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448168.282704:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448168.282705:0:22762:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789448168.282707:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448168.282710:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448168.282711:0:22762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789448168.282720:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789448168.282725:0:22762:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.138@tcp to nid 0x20000c0a8ce8a (192.168.206.138@tcp) 00000020:00000080:2.0:1789448168.282751:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789448168.283792:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9516c7908000) 00000020:00000080:2.0:1789448168.283814:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789448168.283824:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789448168.283897:0:22762:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789448168.283904:0:22762:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789448168.283910:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce453d 00010000:00080000:2.0:1789448168.284270:0:22762:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517f6031800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.138@tcp at head 00010000:00010000:2.0:1789448168.287321:0:22762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789448168.288205:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789448168.288219:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789448168.288253:0:22762:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789448168.288273:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce4544 00000100:00080000:0.0:1789448168.288282:0:22762:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789448168.288294:0:22762:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9517f6031800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448168.288326:0:22762:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770e680 x1876371859268992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789448168.288355:0:22762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789448168.288647:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859268992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448168.288710:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.288795:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859268992 00000100:00100000:2.0:1789448168.288802:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859268992 00000100:00100000:2.0:1789448168.288830:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448168.288837:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859268992:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789448168.288850:0:22749:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1789448168.296705:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448168.296715:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.296717:0:22762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789448168.296721:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789448168.296723:0:22762:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789448168.296724:0:22762:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789448168.296726:0:22762:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789448168.296727:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789448168.296730:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.296731:0:22762:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789448168.296733:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789448168.296738:0:22762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789448168.296741:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.296743:0:22762:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789448168.296745:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789448168.296749:0:22762:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.138@tcp to nid 0x20000c0a8ce8a (192.168.206.138@tcp) 00000020:01000000:0.0:1789448168.296773:0:22762:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789448168.296776:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448168.296808:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9516c6a38000) 00000020:00000080:0.0:1789448168.296826:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789448168.296832:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789448168.296916:0:22762:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789448168.296922:0:22762:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789448168.299185:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce4552 00010000:00080000:0.0:1789448168.299235:0:22762:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517f77a0000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.138@tcp at head 00010000:00010000:0.0:1789448168.299665:0:22762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789448168.305701:0:22762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789448168.306015:0:22762:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789448168.308825:0:22762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448168.309291:0:22762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789448168.324389:0:22762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1789448168.328134:0:22768:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789448168.328141:0:22768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789448168.329228:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789448168.329240:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789448168.329277:0:22762:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789448168.329297:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce4559 00000100:00080000:0.0:1789448168.329308:0:22762:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789448168.329318:0:22762:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9517f77a0000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448168.329351:0:22762:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770d500 x1876371859269120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789448168.329382:0:22762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789448168.329542:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859269120:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789448168.329589:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859269120 offset 0 length 520: 4 00000020:01000000:0.0:1789448168.329721:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448168.329726:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.329728:0:22762:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789448168.329731:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789448168.329733:0:22762:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789448168.329735:0:22762:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789448168.329736:0:22762:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789448168.329738:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789448168.329740:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.329741:0:22762:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789448168.329750:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789448168.329753:0:22762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789448168.329757:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448168.329758:0:22762:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789448168.329761:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789448168.329765:0:22762:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.138@tcp to nid 0x20000c0a8ce8a (192.168.206.138@tcp) 00000020:01000000:0.0:1789448168.329797:0:22762:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789448168.329800:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448168.329811:0:22762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9517f82cb380) 00000020:00000080:0.0:1789448168.329822:0:22762:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789448168.329828:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789448168.329892:0:22762:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789448168.329898:0:22762:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789448168.329904:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6522da1199ce4567 00010000:00080000:0.0:1789448168.329929:0:22762:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517fda0d000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.138@tcp at head 00010000:00010000:0.0:1789448168.330183:0:22762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789448168.330246:0:22762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789448168.330259:0:22762:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1789448168.332949:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859268992:12345-0@lo:38:llog_process_th.0 Request processed in 44104us (44230us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789448168.332962:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789448168.333010:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448168.333015:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789448168.333018:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859268992:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789448168.336955:0:22762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448168.338243:0:22762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789448168.338744:0:22762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1789448168.339489:0:22770:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789448168.339495:0:22770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789448168.340732:0:22762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789448168.340745:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789448168.340857:0:22762:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789448168.340874:0:22762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce456e 00000100:00080000:3.0:1789448168.340884:0:22762:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448168.340893:0:22762:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9517fda0d000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448168.340925:0:22762:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f2a00 x1876371859269248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448168.340991:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859269248:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789448168.341064:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859269248 offset 0 length 520: 4 00000100:00080000:3.0:1789448168.341178:0:22762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789448168.341236:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448168.341241:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448168.341243:0:22762:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789448168.341245:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448168.341249:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448168.341250:0:22762:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789448168.341253:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789448168.341254:0:22762:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789448168.341256:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448168.341258:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448168.341259:0:22762:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789448168.341262:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448168.341264:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448168.341265:0:22762:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789448168.341269:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789448168.341294:0:22762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22762:1876371859269376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448168.341335:0:22762:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448168.341367:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859269376 00000100:00100000:3.0:1789448168.341373:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859269376 00000100:00100000:3.0:1789448168.341403:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448168.341410:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22762:x1876371859269376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448168.341532:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22762:x1876371859269376:12345-0@lo:502:llog_process_th.0 Request processed in 122us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448168.341539:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448168.341576:0:22762:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448168.341590:0:22762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22762:1876371859269376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789448168.341610:0:22762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448168.341613:0:22762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448168.341615:0:22762:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789448168.341618:0:22762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789448168.341722:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789448168.341739:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789448168.341751:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44e9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.341775:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75ee00/0x6522da1199ce44e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44e9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448168.341793:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517fb910000 from 1 10000000:01000000:3.0:1789448168.341795:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789448168.341817:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.341825:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.341844:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448168.341856:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789448168.341878:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448168.341893:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448168.341917:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859269504 00000100:00100000:3.0:1789448168.341920:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859269504 00000100:00100000:3.0:1789448168.341940:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448168.341947:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+9:22724:x1876371859269504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448168.341955:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448168.341965:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4575 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.341983:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4575 expref: 10 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.341993:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4575 expref: 10 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.342001:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477a600, rc 0) 00000100:00100000:3.0:1789448168.342024:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+10:22724:x1876371859269504:12345-0@lo:101:mount.lustre.0 Request processed in 77us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448168.342029:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448168.342055:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448168.342066:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448168.342079:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448168.343364:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269632:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789448168.343657:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448168.343728:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448168.343932:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859269632 00000100:00100000:1.0:1789448168.343939:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859269632 00000100:00100000:1.0:1789448168.343988:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448168.343997:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+10:22724:x1876371859269632:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789448168.344016:0:22738:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789448168.344030:0:22738:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789448168.344181:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+10:22724:x1876371859269632:12345-0@lo:256:mount.lustre.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.344191:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448168.344272:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269632:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789448168.344834:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448168.344851:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.344862:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448168.344870:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517fb910000 from 1 10000000:01000000:0.0:1789448168.344872:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448168.344898:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.344915:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.344925:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.344940:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448168.344971:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.344985:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d3419cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448168.345297:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859269760 00000100:00100000:1.0:1789448168.345304:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859269760 00000100:00100000:1.0:1789448168.345328:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789448168.345335:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+10:22724:x1876371859269760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448168.345346:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448168.345358:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4583 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.345376:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4583 expref: 11 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.345386:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4583 expref: 11 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.345394:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ee200, rc 0) 00000100:00100000:1.0:1789448168.345448:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22724:x1876371859269760:12345-0@lo:101:mount.lustre.0 Request processed in 113us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.345454:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789448168.346254:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448168.346279:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.346289:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448168.346370:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448168.346405:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.346449:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d3419cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.346597:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859269888 00000100:00100000:2.0:1789448168.346603:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859269888 00000100:00100000:2.0:1789448168.346631:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448168.346638:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22724:x1876371859269888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448168.346791:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22724:x1876371859269888:12345-0@lo:501:mount.lustre.0 Request processed in 141us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.346802:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789448168.346938:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859269888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448168.346965:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448168.347002:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.347027:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d3419cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.347075:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270016 00000100:00100000:2.0:1789448168.347079:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270016 00000100:00100000:2.0:1789448168.347107:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448168.347113:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22724:x1876371859270016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448168.347206:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22724:x1876371859270016:12345-0@lo:503:mount.lustre.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.347213:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789448168.347408:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448168.348006:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22772:1876371859270144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448168.348054:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448168.348083:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e741eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.348227:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270144 00000100:00100000:2.0:1789448168.348232:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270144 00000100:00100000:2.0:1789448168.348263:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448168.348270:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22772:x1876371859270144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448168.349390:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22772:x1876371859270144:12345-0@lo:502:llog_process_th.0 Request processed in 1112us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.349405:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448168.354764:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22772:1876371859270144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789448168.354945:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448168.354958:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.354960:0:22772:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789448168.354968:0:22772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9517fb910000 00000020:00000080:1.0:1789448168.354976:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448168.354985:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448168.354988:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.354989:0:22772:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789448168.354992:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448168.354994:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.354995:0:22772:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789448168.354999:0:22772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9517fb910000 00000020:00000080:1.0:1789448168.355001:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448168.355066:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448168.355070:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.355072:0:22772:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789448168.355074:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448168.355077:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.355078:0:22772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789448168.355081:0:22772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9517fb910000 00000020:00000080:1.0:1789448168.355083:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448168.355112:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448168.355115:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.355116:0:22772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789448168.355119:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448168.355121:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.355122:0:22772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789448168.355138:0:22772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9517fb910000 00000020:00000080:1.0:1789448168.355140:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789448168.355188:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22772:1876371859270272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448168.355255:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448168.355300:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e741eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.355636:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270272 00000100:00100000:2.0:1789448168.355643:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270272 00000100:00100000:2.0:1789448168.355699:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448168.355709:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22772:x1876371859270272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448168.355842:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22772:x1876371859270272:12345-0@lo:502:llog_process_th.0 Request processed in 134us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.355849:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789448168.356079:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22772:1876371859270272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789448168.356114:0:22772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448168.356120:0:22772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448168.356126:0:22772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789448168.356130:0:22772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789448168.356870:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789448168.356892:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448168.356909:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.356922:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448168.356968:0:22724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789448168.356971:0:22724:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9517fb910000 10000000:01000000:2.0:1789448168.356974:0:22724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9517fb910000 10000000:01000000:2.0:1789448168.356978:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448168.356983:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9517fb910000 from 1 10000000:01000000:2.0:1789448168.356986:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789448168.357024:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.357032:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.357042:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448168.357067:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448168.357121:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.357149:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448168.357444:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270400 00000100:00100000:0.0:1789448168.357450:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270400 00000100:00100000:0.0:1789448168.357508:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448168.357516:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22724:x1876371859270400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448168.357527:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448168.357539:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517fd75ec00/0x6522da1199ce4598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4591 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.357561:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd75ec00/0x6522da1199ce4598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4591 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.357571:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517fd75ec00/0x6522da1199ce4598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4591 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.357579:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd75ec00, rc 0) 00000100:00100000:0.0:1789448168.357615:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859270400:12345-0@lo:101:mount.lustre.0 Request processed in 100us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448168.357621:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448168.357809:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448168.357823:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4598 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.357832:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4598 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448168.357885:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448168.357910:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.357937:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448168.357982:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270528 00000100:00100000:0.0:1789448168.357987:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270528 00000100:00100000:0.0:1789448168.359042:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448168.359054:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859270528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448168.359201:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859270528:12345-0@lo:501:mount.lustre.0 Request processed in 150us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448168.359210:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789448168.362410:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448168.362964:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448168.363036:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.365029:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da900 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.365198:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270656 00000100:00100000:2.0:1789448168.365207:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270656 00000100:00100000:2.0:1789448168.365252:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448168.365260:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859270656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448168.365397:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859270656:12345-0@lo:503:mount.lustre.0 Request processed in 137us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.365404:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448168.365476:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859270656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448168.365695:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22774:1876371859270784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448168.365734:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.365753:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270784 00000100:00100000:2.0:1789448168.365769:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270784 00000100:00100000:2.0:1789448168.365802:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448168.365808:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22774:x1876371859270784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789448168.365888:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22774:x1876371859270784:12345-0@lo:502:llog_process_th.0 Request processed in 79us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.365895:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448168.365921:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448168.365932:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22774:1876371859270784:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789448168.365979:0:22774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789448168.365992:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9516c790b380) 00000020:00000080:2.0:1789448168.366010:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789448168.368767:0:22774:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517fb910000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789448168.368776:0:22774:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517fb910000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789448168.368789:0:22774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517fb910000 4 00010000:00080000:2.0:1789448168.368823:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517c3b7b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.138@tcp at head 00010000:00010000:3.0:1789448168.380709:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789448168.380910:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789448168.380951:0:22774:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789448168.380965:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6522da1199ce45a6 00000100:00080000:3.0:1789448168.380973:0:22774:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789448168.380983:0:22774:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9517c3b7b800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448168.381018:0:22774:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f3b80 x1876371859270912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448168.381039:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789448168.381151:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3631:1876371859270912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448168.381213:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448168.384937:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859270912 00000100:00100000:3.0:1789448168.384952:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859270912 00000100:00100000:3.0:1789448168.384991:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448168.384999:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3631:x1876371859270912:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789448168.385113:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3631:x1876371859270912:12345-0@lo:38:llog_process_th.0 Request processed in 113us (3899us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789448168.385120:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789448168.385260:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22774:1876371859271040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448168.385311:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448168.385340:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448168.385676:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789448168.385684:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517c3b7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448168.385688:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789448168.385692:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3631:1876371859270912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789448168.386677:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271040 00000100:00100000:0.0:1789448168.386686:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271040 00000100:00100000:0.0:1789448168.386732:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448168.386747:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22774:x1876371859271040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789448168.386885:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22774:x1876371859271040:12345-0@lo:502:llog_process_th.0 Request processed in 140us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448168.386893:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789448168.386994:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22774:1876371859271040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448168.387170:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22774:1876371859271168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789448168.387213:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448168.387286:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448168.392570:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271168 00000100:00100000:0.0:1789448168.392584:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271168 00000100:00100000:1.0:1789448168.396640:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789448168.396654:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22774:x1876371859271168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789448168.396832:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22774:x1876371859271168:12345-0@lo:502:llog_process_th.0 Request processed in 181us (9618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.396840:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448168.399898:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:562d8d7b-adf5-44cc-8730-f8665ac1447a:22774:1876371859271168:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789448168.399946:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789448168.403613:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789448168.403650:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789448168.403677:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4598 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448168.403690:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ca00/0x6522da1199ce4591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4598 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789448168.403741:0:22724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789448168.403743:0:22724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448168.403744:0:22724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448168.403745:0:22724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448168.403746:0:22724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448168.403747:0:22724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448168.403749:0:22724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448168.403750:0:22724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448168.403751:0:22724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448168.403753:0:22724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448168.403756:0:22724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789448168.403758:0:22724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789448168.403759:0:22724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789448168.403760:0:22724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448168.403772:0:22724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448168.403773:0:22724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448168.403774:0:22724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448168.403775:0:22724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448168.403785:0:22724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789448168.403786:0:22724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448168.403793:0:22724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448168.403818:0:22724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789448168.403836:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859271296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789448168.403899:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448168.403935:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448168.403957:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271296 00000100:00100000:0.0:1789448168.403965:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271296 00000100:00100000:0.0:1789448168.404008:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789448168.404016:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859271296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789448168.404042:0:22739:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789448168.404296:0:22739:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789448168.412326:0:22739:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789448168.412349:0:22739:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789448168.412596:0:22760:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789448168.412601:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789448168.412624:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.412641:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4575 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.412650:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.412686:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4575 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.412711:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4575 expref: 12 pid: 22739 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448168.412726:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859271424:0@lo:104: 00000100:00100000:2.0:1789448168.412797:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.412838:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517c4f1f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789448168.412985:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271424 00000100:00100000:1.0:1789448168.412993:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271424 00000100:00100000:1.0:1789448168.413039:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448168.413055:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859271424:12345-0@lo:104: 00010000:00010000:1.0:1789448168.413067:0:22728:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448168.413127:0:22728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789448168.413133:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859271424:12345-0@lo:104: Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448168.413139:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448168.413375:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22724:x1876371859271296:12345-0@lo:253:mount.lustre.0 Request processed in 9358us (9474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448168.413384:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789448168.413529:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448168.413536:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413544:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b200 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:2.0:1789448168.413548:0:22734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413556:0:22734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448168.413563:0:22734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448168.413570:0:22734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448168.413607:0:22734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413614:0:22734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448168.413634:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413641:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d477b200/0x6522da1199ce4575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce457c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413665:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448168.413666:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448168.413668:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448168.413698:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859271552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448168.413729:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448168.413811:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271552 00000100:00100000:2.0:1789448168.413817:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271552 00010000:00010000:2.0:1789448168.413836:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4575 expref: 12 pid: 22739 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448168.413856:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448168.413864:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:3634:x1876371859271552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448168.413875:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448168.413880:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4575 expref: 12 pid: 22739 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413891:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4575 expref: 12 pid: 22739 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413906:0:22730:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413913:0:22730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789448168.413927:0:22730:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001326065s 00010000:00010000:2.0:1789448168.413931:0:22730:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413947:0:22730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413953:0:22730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413958:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413964:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8d600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448168.413967:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413974:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413981:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.413991:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448168.414021:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:3634:x1876371859271552:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448168.414029:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448168.414184:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859271552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448168.414211:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477a600/0x6522da1199ce457c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4575 expref: 11 pid: 22739 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448168.414221:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7412d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859271424:0@lo:104: 00010000:00010000:2.0:1789448168.414231:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.414245:0:22760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.414250:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448168.414256:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8d600/0x6522da1199ce45ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448168.414395:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:22724:1876371859271296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789448168.414405:0:22724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789448168.414408:0:22724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789448168.414409:0:22724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789448168.414411:0:22724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448168.414423:0:22724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448168.414425:0:22724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448168.414426:0:22724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448168.414427:0:22724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789448168.414429:0:22724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789448168.414430:0:22724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448168.414431:0:22724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789448168.414447:0:22724:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1789448168.438396:0:22724:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1789448168.439261:0:22724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789448168.440954:0:22785:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:1.0:1789448168.441308:0:22784:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1789448168.441313:0:22784:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:0.0:1789448168.441325:0:22785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789448168.442231:0:22724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789448168.442754:0:22786:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9517fb9e0380 x1876371859271680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448168.442775:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000040:01000000:3.0:1789448168.443362:0:22724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789448168.443403:0:22724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789448168.443869:0:22724:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789448168.443878:0:22724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789448168.443914:0:22724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448168.446634:0:22785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789448168.446704:0:22785:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789448168.448853:0:22724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789448168.451332:0:22724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789448168.451399:0:22724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789448168.452571:0:22724:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1789448168.453278:0:22724:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1789448168.455369:0:22724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1789448168.465339:0:22724:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789448168.465377:0:22724:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb33cc1c2b988 00100000:10000000:3.0:1789448168.465385:0:22724:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789448168.468251:0:22724:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789448168.468268:0:22724:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789448168.468288:0:22724:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789448168.468314:0:22724:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789448168.477401:0:22724:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448168.477643:0:22724:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789448169.082287:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448169.461551:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000040:00080000:2.0:1789448169.462370:0:22780:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789448169.462376:0:22780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448169.473025:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789448169.473040:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1789448170.105565:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789448170.105573:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517fb910000 from 11 10000000:01000000:0.0:1789448170.105578:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789448170.105616:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448170.105620:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448170.105632:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448170.105654:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448170.105678:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859271808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789448170.105739:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448170.105807:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd989900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448170.106762:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271808 00000100:00100000:3.0:1789448170.106781:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271808 00000100:00100000:3.0:1789448170.106845:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789448170.106855:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+11:22742:x1876371859271808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448170.106868:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448170.106882:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce45b4 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448170.106908:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 12 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448170.106918:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 12 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448170.106927:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477aa00, rc 0) 00000100:00100000:3.0:1789448170.106992:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22742:x1876371859271808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448170.106998:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789448170.107037:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859271808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448170.107053:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448170.107062:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448170.107137:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859271936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789448170.107173:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448170.107210:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd989900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448170.107224:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271936 00000100:00100000:0.0:1789448170.107228:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271936 00000100:00100000:0.0:1789448170.107253:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448170.107260:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22742:x1876371859271936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789448170.107273:0:22739:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789448170.107289:0:22739:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789448170.107292:0:22739:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789448170.107385:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:22742:x1876371859271936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448170.107393:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448170.107451:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859271936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789448170.107508:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448170.107515:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448170.107523:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448170.485599:0:22780:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789448170.485606:0:22780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448170.485722:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1789448170.485755:0:22780:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789448170.485903:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1789448170.486698:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:2.0:1789448171.129852:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448171.513431:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:1.0:1789448172.159150:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448172.535089:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000001:02000400:3.0:1789448172.865095:0:23028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg638-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789448173.196943:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448173.560233:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000100:00080000:0.0:1789448173.751309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789448173.751316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789448173.751319:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448173.751327:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 570 00000100:00080000:0.0:1789448173.751332:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789448173.751342:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9517f6031800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448173.751362:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770f100 x1876371859272192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789448173.751377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448173.751393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448173.751396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448173.751399:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448173.751402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789448173.751405:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789448173.751407:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517c3b7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448173.751421:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9517c3b7b800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448173.751434:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770ea00 x1876371859272320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448173.751557:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859272064:0@lo:400:kworker.0 00000100:00100000:3.0:1789448173.751618:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448173.751673:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272192:0@lo:38:kworker.0 00000100:00100000:3.0:1789448173.751703:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448173.751721:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3631:1876371859272320:0@lo:38:kworker.0 00000100:00100000:3.0:1789448173.751742:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448173.751797:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859272192 00000100:00100000:3.0:1789448173.751804:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859272192 00000100:00100000:3.0:1789448173.751831:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448173.751837:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859272192:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789448173.751852:0:22750:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789448173.751888:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859272192:12345-0@lo:38:kworker.0 Request processed in 49us (183us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789448173.751894:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789448173.751927:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448173.751932:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789448173.751935:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272192:0@lo:38:kworker.0 00000100:00100000:0.0:1789448173.752141:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859272064 00000100:00100000:0.0:1789448173.752146:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859272064 00000100:00100000:0.0:1789448173.752193:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789448173.752200:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:3635:x1876371859272064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448173.752240:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:3635:x1876371859272064:12345-0@lo:400:kworker.0 Request processed in 41us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448173.752247:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789448173.752281:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859272320 00000100:00100000:0.0:1789448173.752285:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859272320 00000100:00100000:0.0:1789448173.752299:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789448173.752304:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3631:x1876371859272320:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789448173.752319:0:22746:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1789448173.752352:0:22746:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6522da1199ce45c2 00000004:00100000:0.0:1789448173.752365:0:22746:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789448173.752671:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9517ffd5b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448173.752710:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1876371859272320:12345-0@lo:38:kworker.0 Request processed in 404us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448173.752716:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448173.753506:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859272064:0@lo:400:kworker.0 00010000:00080000:3.0:1789448173.753538:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9516c770ea00 x1876371859272320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448173.753552:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789448173.753560:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789448173.753565:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789448173.753567:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517c3b7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789448173.753584:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3631:1876371859272320:0@lo:38:kworker.0 00000020:00000004:3.0:1789448173.836547:0:23080:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789448173.836705:0:23080:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789448174.199730:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448174.586628:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000020:00000004:0.0:1789448174.644334:0:23130:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448174.644655:0:23130:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789448175.221617:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448175.609020:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:1.0:1789448176.247826:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448176.630996:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:1.0:1789448177.272267:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448177.655508:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:2.0:1789448178.295973:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448178.679486:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000100:00100000:2.0:1789448178.869568:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448168/real 1789448168] req@ffff9516c82f2a00 x1876371859269248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448178.869597:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9516c82f2a00 x1876371859269248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448178.869608:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448168/real 1789448168] req@ffff9516c770d500 x1876371859269120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448178.869620:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9516c770d500 x1876371859269120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789448178.869638:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448178.869659:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789448178.869663:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859269248:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789448178.869676:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448178.869681:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789448178.869685:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859269120:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789448178.870106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789448178.870111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789448178.870113:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448178.870118:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1789448178.870123:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789448178.870133:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9517f6031800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448178.870151:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e2300 x1876371859272576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448178.870164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448178.870167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789448178.870168:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448178.870171:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 570 00000100:00080000:1.0:1789448178.870174:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789448178.870185:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9517f77a0000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448178.870197:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e3100 x1876371859272704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448178.870206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448178.870209:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789448178.870211:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448178.870214:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 570 00000100:00080000:1.0:1789448178.870216:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789448178.870220:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9517fda0d000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448178.870230:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e3800 x1876371859272832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789448178.870297:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859272960:0@lo:400:kworker.0 00000100:00100000:1.0:1789448178.870358:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448178.870402:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448178.870408:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:562d8d7b-adf5-44cc-8730-f8665ac1447a:3633:1876371859272448:0@lo:400:kworker.0 00000100:00100000:1.0:1789448178.870434:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448178.870868:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859272960 00000100:00100000:1.0:1789448178.870875:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859272960 00000100:00100000:1.0:1789448178.870987:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448178.870995:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859272960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448178.871049:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859272960:12345-0@lo:400:kworker.0 Request processed in 55us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448178.871056:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448178.874506:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859272448 00000100:00100000:0.0:1789448178.874532:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859272448 00000100:00100000:0.0:1789448178.874581:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789448178.874597:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:3633:x1876371859272448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448178.874671:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:3633:x1876371859272448:12345-0@lo:400:kworker.0 Request processed in 77us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448178.874678:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789448178.874719:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272576:0@lo:38:kworker.0 00000100:00100000:0.0:1789448178.874767:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448178.874794:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272704:0@lo:8:kworker.0 00000400:00000100:0.0:1789448178.874814:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859272704 offset 0 length 520: 4 00000100:00100000:0.0:1789448178.874834:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272832:0@lo:8:kworker.0 00000400:00000100:0.0:1789448178.874865:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859272832 offset 0 length 520: 4 00000100:00100000:0.0:1789448178.874891:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859272576 00000100:00100000:0.0:1789448178.874895:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859272576 00000100:00100000:0.0:1789448178.874915:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789448178.874920:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859272576:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789448178.874935:0:22750:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789448178.874966:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859272576:12345-0@lo:38:kworker.0 Request processed in 45us (199us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789448178.874972:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789448178.875002:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789448178.875007:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789448178.875010:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272576:0@lo:38:kworker.0 00000100:00100000:0.0:1789448178.875044:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:562d8d7b-adf5-44cc-8730-f8665ac1447a:3633:1876371859272448:0@lo:400:kworker.0 00010000:00080000:0.0:1789448178.875061:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9517fb9e0700 x1876371859272960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448178.875082:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859272960:0@lo:400:kworker.0 00010000:00010000:3.0:1789448179.318794:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448179.708515:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:2.0:1789448180.342575:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448180.726332:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789448180.726692:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:3.0:1789448181.367548:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789448181.744353:0:23475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789448181.744357:0:23475:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789448181.744358:0:23475:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789448181.744760:0:23475:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9517d3af2000 00000020:01000004:2.0:1789448181.744774:0:23475:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789448181.744785:0:23475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789448181.744798:0:23475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9516c79099c0) 00000020:00000080:2.0:1789448181.744812:0:23475:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1789448181.749576:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00100000:10000000:0.0:1789448181.820560:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789448181.823908:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789448181.825790:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789448181.826023:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789448181.826240:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789448181.826406:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789448181.826601:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789448181.827110:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789448181.827317:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.831155:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.832161:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.832424:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.832657:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.832942:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.833156:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.833368:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.833610:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.833992:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.835653:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.836158:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.836414:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.836700:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.837105:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.837323:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.837616:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.837829:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.838805:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.839117:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.839409:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.839812:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.840236:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.840444:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.840684:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789448181.840987:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789448181.842776:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789448181.843604:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789448181.844006:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789448181.844293:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789448181.844543:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789448181.844740:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789448181.845023:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789448181.845275:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789448181.845524:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789448181.845828:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789448181.851641:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789448181.852020:0:23475:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:01000000:1.0:1789448181.852781:0:23475:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789448181.853177:0:23475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789448181.853187:0:23475:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789448181.853198:0:23475:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6522da1199ce45d0 00000020:01000004:1.0:1789448181.853204:0:23475:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789448181.853221:0:23475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789448181.853224:0:23475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789448181.853230:0:23475:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789448181.853263:0:23475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789448181.853267:0:23475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789448181.859394:0:23475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789448181.859434:0:23475:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.138@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789448181.859439:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789448181.859441:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789448181.859442:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448181.859444:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448181.859445:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448181.859446:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448181.859448:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789448181.859449:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448181.859451:0:23475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789448181.859455:0:23475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789448181.859500:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789448181.859502:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789448181.859503:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448181.859504:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448181.859505:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448181.859506:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448181.859507:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789448181.859508:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448181.859509:0:23475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789448181.859533:0:23475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789448181.859551:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789448181.859619:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.859815:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efe9dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448181.863831:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273088 00000100:00100000:3.0:1789448181.863846:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273088 00000100:00100000:3.0:1789448181.864307:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789448181.864320:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:23475:x1876371859273088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789448181.864355:0:22738:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789448181.864358:0:22738:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789448181.864365:0:22738:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789448181.866734:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:23475:x1876371859273088:12345-0@lo:253:mount.lustre.0 Request processed in 2411us (7107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448181.866747:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789448181.866835:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789448181.866848:0:23475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789448181.866851:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789448181.866853:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789448181.866854:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448181.866855:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448181.866856:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448181.866857:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448181.866859:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789448181.866861:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448181.866862:0:23475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789448181.866897:0:23475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9517d3af2000 from lustre-MDT0001 10000000:01000000:1.0:1789448181.866930:0:23475:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789448181.866933:0:23475:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789448181.866939:0:23475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9516c6734d40 local copy 00010000:00010000:1.0:1789448181.866948:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448181.867072:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448181.867108:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.868942:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273216 00000100:00100000:1.0:1789448181.869539:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efe9d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448181.869595:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273216 00000100:00100000:0.0:1789448181.869645:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789448181.869653:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:23475:x1876371859273216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448181.869786:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:23475:x1876371859273216:12345-0@lo:501:mount.lustre.0 Request processed in 133us (2677us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448181.869794:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789448181.869885:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789448181.869917:0:23475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789448181.869940:0:23475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789448181.869948:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.870456:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448181.870623:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9517d3af2000 10000000:01000000:1.0:1789448181.870630:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789448181.870635:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9516c6734d40 10000000:01000000:1.0:1789448181.870638:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789448181.870641:0:23475:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9516c6734d40 from 1 10000000:01000000:1.0:1789448181.870644:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789448181.870676:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.870685:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.870694:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448181.870726:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789448181.870765:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448181.870839:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efe9d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448181.870875:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273344 00000100:00100000:0.0:1789448181.870880:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273344 00000100:00100000:0.0:1789448181.870905:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789448181.870913:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+12:23475:x1876371859273344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448181.870935:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448181.870947:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517fd75e000/0x6522da1199ce45de lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce45d7 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.871208:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd75e000/0x6522da1199ce45de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce45d7 expref: 13 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.871292:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517fd75e000/0x6522da1199ce45de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce45d7 expref: 13 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.871302:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd75e000, rc 0) 00000100:00100000:0.0:1789448181.871345:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+13:23475:x1876371859273344:12345-0@lo:101:mount.lustre.0 Request processed in 433us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448181.871352:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789448181.871432:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448181.871446:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45de expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.871491:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce45de expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448181.871510:0:23475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789448181.871528:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45de expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.871536:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d90ee600/0x6522da1199ce45d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45de expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448181.871544:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9517d3af2000 10000000:01000000:1.0:1789448181.871548:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789448181.871552:0:23475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9517d3af2000 from 1 10000000:01000000:1.0:1789448181.871554:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789448181.871569:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.871576:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.871584:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448181.871597:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789448181.871623:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448181.871652:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efe9d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448181.871672:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273472 00000100:00100000:2.0:1789448181.871677:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273472 00000100:00100000:2.0:1789448181.871708:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789448181.871726:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+13:23475:x1876371859273472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448181.871733:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448181.871742:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c7b8c000/0x6522da1199ce45ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce45e5 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448181.871756:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8c000/0x6522da1199ce45ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce45e5 expref: 14 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448181.871764:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c7b8c000/0x6522da1199ce45ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce45e5 expref: 14 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448181.871771:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b8c000, rc 0) 00000100:00100000:2.0:1789448181.871813:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+14:23475:x1876371859273472:12345-0@lo:101:mount.lustre.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448181.871832:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789448181.872027:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448181.872103:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45ec expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.872111:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce45ec expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448181.872121:0:23475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789448181.872173:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45ec expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.872182:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d90efc00/0x6522da1199ce45e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45ec expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448181.872188:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789448181.872198:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448181.872203:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9517d3af2000 10000000:01000000:0.0:1789448181.872205:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789448181.872208:0:23475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789448181.872210:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789448181.872226:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.872233:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.872240:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448181.872252:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448181.872280:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.872303:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448181.872428:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273600 00000100:00100000:1.0:1789448181.872433:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273600 00000100:00100000:1.0:1789448181.872502:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789448181.872509:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+14:23475:x1876371859273600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448181.872625:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448181.872637:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90eec00/0x6522da1199ce45fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce45f3 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.872652:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90eec00/0x6522da1199ce45fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce45f3 expref: 15 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.872661:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90eec00/0x6522da1199ce45fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce45f3 expref: 15 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448181.872668:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90eec00, rc 0) 00000100:00100000:1.0:1789448181.872698:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273600:12345-0@lo:101:mount.lustre.0 Request processed in 190us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448181.872704:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789448181.872764:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448181.872781:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45fa expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.872789:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce45fa expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448181.874246:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1789448181.874869:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448181.879409:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789448181.879455:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1789448181.879705:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1789448181.879731:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1789448181.879753:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1789448181.879764:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1789448181.879774:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1789448181.879786:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1789448181.879796:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1789448181.879807:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1789448181.879818:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1789448181.879829:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1789448181.879841:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1789448181.879852:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1789448181.879862:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1789448181.879873:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1789448181.879935:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1789448181.879949:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1789448181.879961:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1789448181.879976:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1789448181.879990:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1789448181.880003:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1789448181.880017:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1789448181.880087:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1789448181.880107:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1789448181.880122:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1789448181.880135:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1789448181.880146:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1789448181.880158:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1789448181.880169:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1789448181.880180:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1789448181.880191:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1789448181.880201:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1789448181.880212:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1789448181.880222:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1789448181.880232:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1789448181.880309:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1789448181.880329:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1789448181.880340:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1789448181.880351:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1789448181.880361:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1789448181.880372:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1789448181.880385:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1789448181.880395:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1789448181.880417:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1789448181.880422:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1789448181.880632:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448181.880688:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.880744:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448181.880808:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273728 00000100:00100000:3.0:1789448181.880815:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273728 00000100:00100000:3.0:1789448181.880902:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789448181.880912:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448181.881056:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273728:12345-0@lo:501:mount.lustre.0 Request processed in 146us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448181.881064:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789448181.881127:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448181.881159:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448181.881199:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.881491:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448181.881632:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273856 00000100:00100000:2.0:1789448181.881638:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273856 00000100:00100000:2.0:1789448181.881664:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789448181.881671:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448181.882417:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273856:12345-0@lo:503:mount.lustre.0 Request processed in 743us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448181.882426:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789448181.882855:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273856:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789448181.883540:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789448181.883614:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448181.883666:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.883706:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448181.883938:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859273984 00000100:00100000:3.0:1789448181.883950:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859273984 00000100:00100000:3.0:1789448181.883991:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789448181.884000:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448181.885629:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859273984:12345-0@lo:502:mount.lustre.0 Request processed in 1625us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448181.885642:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789448181.885763:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859273984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448181.885973:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789448181.886001:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1789448181.886014:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1789448181.886028:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1789448181.886041:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1789448181.886081:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1789448181.886096:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1789448181.886107:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1789448181.886120:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1789448181.886134:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1789448181.886148:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1789448181.886160:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1789448181.886180:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1789448181.886197:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1789448181.886211:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1789448181.886226:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1789448181.886255:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1789448181.886273:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1789448181.886289:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1789448181.886303:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1789448181.886318:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1789448181.886333:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1789448181.886348:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1789448181.886363:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1789448181.886378:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1789448181.886392:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1789448181.886406:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1789448181.886420:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1789448181.886432:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1789448181.886443:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1789448181.886453:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1789448181.886486:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1789448181.886500:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1789448181.886512:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1789448181.886524:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1789448181.886537:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1789448181.886549:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1789448181.886562:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1789448181.886586:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1789448181.886601:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1789448181.886613:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1789448181.886624:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1789448181.886636:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1789448181.886647:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1789448181.886683:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859274112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448181.886749:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.886784:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448181.887062:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859274112 00000100:00100000:1.0:1789448181.887070:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859274112 00000100:00100000:1.0:1789448181.887119:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789448181.887128:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859274112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448181.887247:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859274112:12345-0@lo:502:mount.lustre.0 Request processed in 107us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448181.887255:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789448181.887738:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859274112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789448181.887807:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789448181.887818:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789448181.889199:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448181.889211:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448181.889213:0:23479:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789448181.889220:0:23479:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789448181.889223:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448181.889309:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9516c6428000) 00000020:00000080:3.0:1789448181.889331:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789448181.889338:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789448181.889416:0:23479:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789448181.889423:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6522da1199ce4608 00000020:00000080:3.0:1789448181.889650:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789448181.889654:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448181.889658:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448181.889660:0:23479:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789448181.889663:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448181.889666:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448181.889668:0:23479:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789448181.889671:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448181.889678:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9516c642b380) 00000020:00000080:3.0:1789448181.889688:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789448181.889692:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789448181.889700:0:23479:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789448181.889703:0:23479:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789448181.889710:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448181.889775:0:23479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517d3af2000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789448181.889787:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9516c64299c0) 00000020:00000080:3.0:1789448181.889796:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789448181.889850:0:23479:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789448181.889856:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce461d 00000020:00000080:3.0:1789448181.890295:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789448181.890302:0:23479:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789448181.890307:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6522da1199ce4624 00080000:01000000:3.0:1789448181.890314:0:23479:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789448181.890317:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6522da1199ce462b 00010000:00010000:1.0:1789448181.971451:0:23479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789448181.972332:0:23479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1789448181.972799:0:23479:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789448181.973921:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789448181.973932:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448181.973938:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448181.973941:0:23479:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789448181.973944:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448181.973950:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448181.973952:0:23479:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789448181.973955:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789448181.973961:0:23479:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.138@tcp to nid 0x20000c0a8ce8a (192.168.206.138@tcp) 00000020:00000080:0.0:1789448181.973989:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789448181.974002:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9517f82c99c0) 00000020:00000080:0.0:1789448181.974189:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789448181.974198:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789448181.974261:0:23479:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789448181.974268:0:23479:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789448181.974276:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6522da1199ce4639 00010000:00080000:0.0:1789448181.974315:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9516c7705000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.138@tcp at head 00010000:00010000:0.0:1789448181.980339:0:23479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789448181.981383:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789448181.981398:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789448181.981441:0:23479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789448181.981488:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce4640 00000100:00080000:1.0:1789448181.981499:0:23479:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789448181.981511:0:23479:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9516c7705000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448181.981548:0:23479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e3480 x1876371859274240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448181.981569:0:23479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789448181.981632:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448181.981636:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448181.981639:0:23479:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789448181.981642:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789448181.981645:0:23479:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789448181.981646:0:23479:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789448181.981648:0:23479:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789448181.981649:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789448181.981652:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448181.981653:0:23479:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789448181.981656:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448181.981660:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448181.981662:0:23479:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789448181.981666:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789448181.981694:0:23479:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789448181.981709:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448181.981725:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448181.981726:0:23479:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789448181.981729:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789448181.981731:0:23479:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789448181.981732:0:23479:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789448181.981734:0:23479:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789448181.981736:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789448181.981738:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448181.981739:0:23479:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789448181.981742:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789448181.981750:0:23479:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789448181.981754:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448181.981755:0:23479:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789448181.981759:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789448181.981762:0:23479:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.138@tcp to nid 0x20000c0a8ce8a (192.168.206.138@tcp) 00000020:01000000:1.0:1789448181.981782:0:23479:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789448181.981785:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789448181.981797:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9517f9394d40) 00000020:00000080:1.0:1789448181.981809:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789448181.981814:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789448181.981880:0:23479:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789448181.981887:0:23479:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789448181.981893:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6522da1199ce464e 00010000:00080000:1.0:1789448181.981922:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517ca4b7800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.138@tcp at head 00000100:00080000:3.0:1789448181.982136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789448181.982142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789448181.982145:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448181.982149:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1789448181.982153:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789448181.982159:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9517f6031800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448181.982177:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f0000 x1876371859274368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448181.982187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448181.982190:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448181.982192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448181.982195:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789448181.982225:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789448181.982285:0:23479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789448181.982307:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876371859274496:0@lo:400:kworker.0 00000100:00100000:3.0:1789448181.982570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448181.982613:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859274496 00000100:00100000:3.0:1789448181.982621:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859274496 00000100:00100000:3.0:1789448181.982661:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448181.982670:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876371859274496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448181.982733:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876371859274496:12345-0@lo:400:kworker.0 Request processed in 63us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448181.982739:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789448181.982775:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9516c82f1880 x1876371859274496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448181.982787:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876371859274496:0@lo:400:kworker.0 00000040:01000000:1.0:1789448181.983354:0:23479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789448181.983623:0:23479:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1789448181.983864:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859274240:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448181.983912:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448181.983948:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859274368:0@lo:38:kworker.0 00000100:00100000:2.0:1789448181.983982:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448181.984040:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859274240 00000100:00100000:2.0:1789448181.984045:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859274240 00000100:00100000:3.0:1789448181.984048:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859274368 00000100:00100000:3.0:1789448181.984051:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859274368 00000100:00100000:2.0:1789448181.984064:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448181.984070:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859274240:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789448181.984091:0:22749:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:2.0:1789448181.984122:0:22749:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce4655 00000004:00100000:2.0:1789448181.984135:0:22749:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789448181.984139:0:22749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:1.0:1789448181.986266:0:23479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448181.986491:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789448181.986934:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789448181.988865:0:23485:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789448181.988871:0:23485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1789448181.989231:0:22749:0:(import.c:65:import_set_state_nolock()) ffff9517d3255800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448181.989323:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3631:x1876371859274240:12345-0@lo:38:llog_process_th.0 Request processed in 5249us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448181.990633:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448181.990668:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789448181.990685:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859274368:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789448181.990769:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3631:x1876371859274368:12345-0@lo:38:kworker.0 Request processed in 83us (6786us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789448181.990777:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789448181.990817:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448181.990826:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789448181.990834:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789448181.990838:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789448181.990841:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c7705000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789448181.990864:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859274240:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448181.990877:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448181.990880:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448181.990883:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789448181.990886:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859274368:0@lo:38:kworker.0 00000020:00000080:2.0:1789448181.991750:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789448181.991764:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789448181.991805:0:23479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789448181.991824:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce465c 00000100:00080000:2.0:1789448181.991832:0:23479:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789448181.991841:0:23479:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9517ca4b7800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448181.991871:0:23479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7410e00 x1876371859274624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448181.991902:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859274624:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789448181.991956:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859274624 offset 0 length 520: 4 00000100:00080000:2.0:1789448181.991993:0:23479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789448181.992089:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448181.992093:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.992095:0:23479:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789448181.992098:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789448181.992101:0:23479:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789448181.992102:0:23479:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789448181.992104:0:23479:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789448181.992105:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789448181.992107:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.992108:0:23479:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789448181.992111:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789448181.992114:0:23479:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789448181.992117:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.992119:0:23479:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789448181.992122:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789448181.992125:0:23479:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.138@tcp to nid 0x20000c0a8ce8a (192.168.206.138@tcp) 00000020:01000000:2.0:1789448181.992144:0:23479:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789448181.992146:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789448181.992163:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9517f22399c0) 00000020:00000080:2.0:1789448181.992175:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789448181.992181:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789448181.992241:0:23479:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789448181.992248:0:23479:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789448181.992256:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6522da1199ce466a 00010000:00080000:2.0:1789448181.992282:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517fd6fd000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.138@tcp at head 00010000:00010000:2.0:1789448181.992510:0:23479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789448181.992877:0:23479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789448181.992893:0:23479:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1789448181.993231:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448181.993245:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859274752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448181.993295:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.993911:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859274752 00000100:00100000:0.0:1789448181.993920:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859274752 00000100:00100000:0.0:1789448181.993969:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448181.993979:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876371859274752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448181.994027:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789448181.994095:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876371859274752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448181.994102:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448181.994457:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859274752:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789448181.995814:0:23479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448181.996201:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789448181.996322:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00080000:1.0:1789448181.996558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448181.996564:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448181.996566:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448181.996569:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789448181.996800:0:23487:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789448181.996805:0:23487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789448181.997900:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789448181.997913:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789448181.998207:0:23479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789448181.998231:0:23479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce4671 00000100:00080000:2.0:1789448181.998311:0:23479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789448181.998322:0:23479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9517fd6fd000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:2.0:1789448181.998357:0:23479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517e7411c00 x1876371859274880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789448181.998386:0:23479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789448181.998417:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859274880:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789448181.998487:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859274880 offset 0 length 520: 4 00000020:01000000:2.0:1789448181.998511:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448181.998516:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.998518:0:23479:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789448181.998521:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448181.998525:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.998526:0:23479:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789448181.998529:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789448181.998530:0:23479:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789448181.998532:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448181.998534:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.998535:0:23479:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789448181.998537:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789448181.998539:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.998541:0:23479:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789448181.998544:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789448181.998569:0:23479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789448181.998572:0:23479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448181.998573:0:23479:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789448181.998576:0:23479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:1.0:1789448181.998641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448181.998655:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448181.998658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448181.998660:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789448181.998764:0:23475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789448181.998793:0:23475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789448181.998813:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45fa expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.998823:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75e200/0x6522da1199ce45f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce45fa expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448181.998832:0:23475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517d3af2000 from 1 10000000:01000000:0.0:1789448181.998834:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789448181.998857:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.998865:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.998875:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448181.998889:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448181.998928:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448181.999089:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d308d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789448181.999159:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275008 00000100:00100000:3.0:1789448181.999166:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275008 00000100:00100000:3.0:1789448181.999247:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789448181.999256:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+15:23475:x1876371859275008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448181.999269:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448181.999280:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4678 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448181.999302:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4678 expref: 16 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448181.999313:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4678 expref: 16 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448181.999321:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477bc00, rc 0) 00000100:00100000:3.0:1789448181.999369:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:23475:x1876371859275008:12345-0@lo:101:mount.lustre.0 Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448181.999375:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448181.999437:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448181.999450:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448181.999476:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448182.000018:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275136:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789448182.000065:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.000605:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d308d840 going to sleep for 10 seconds 00000100:00100000:1.0:1789448182.000723:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275136 00000100:00100000:1.0:1789448182.000729:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275136 00000100:00100000:1.0:1789448182.000761:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789448182.000769:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:23475:x1876371859275136:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789448182.000787:0:22739:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789448182.000806:0:22739:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789448182.000809:0:22739:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789448182.000899:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:23475:x1876371859275136:12345-0@lo:256:mount.lustre.0 Request processed in 130us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448182.000907:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448182.001267:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275136:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789448182.001921:0:23475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448182.001940:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448182.001950:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448182.001972:0:23475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517d3af2000 from 1 10000000:01000000:0.0:1789448182.001975:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448182.002005:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448182.002023:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448182.002051:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448182.002069:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448182.002112:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.002136:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d308d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789448182.002415:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275264 00000100:00100000:1.0:1789448182.002422:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275264 00000100:00100000:1.0:1789448182.002454:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789448182.002493:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:23475:x1876371859275264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448182.002505:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448182.002527:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4686 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448182.002551:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4686 expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448182.002562:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4686 expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448182.002581:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90eea00, rc 0) 00000100:00100000:1.0:1789448182.002619:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275264:12345-0@lo:101:mount.lustre.0 Request processed in 129us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448182.002625:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448182.003201:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448182.003215:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448182.003224:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448182.005349:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789448182.005651:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448182.005855:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789448182.005879:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789448182.005891:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789448182.005903:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789448182.005918:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789448182.005932:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789448182.005945:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789448182.005976:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789448182.005994:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789448182.006273:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1789448182.006300:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1789448182.006321:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1789448182.006326:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1789448182.006401:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448182.006506:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.006612:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448182.006880:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275392 00000100:00100000:3.0:1789448182.006888:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275392 00000100:00100000:3.0:1789448182.006940:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789448182.006950:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448182.007263:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275392:12345-0@lo:501:mount.lustre.0 Request processed in 314us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.007270:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789448182.007367:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448182.007418:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448182.007500:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448182.007531:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448182.007655:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275520 00000100:00100000:3.0:1789448182.007660:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275520 00000100:00100000:3.0:1789448182.007682:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789448182.007688:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789448182.007836:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275520:12345-0@lo:503:mount.lustre.0 Request processed in 147us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.007843:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789448182.008730:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789448182.009155:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448182.009507:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448182.009566:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448182.009603:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e0a2e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448182.009895:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275648 00000100:00100000:3.0:1789448182.009902:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275648 00000100:00100000:3.0:1789448182.009950:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789448182.009959:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448182.010197:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275648:12345-0@lo:502:mount.lustre.0 Request processed in 238us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.010205:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789448182.010322:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448182.011291:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789448182.011325:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1789448182.011336:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1789448182.011347:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1789448182.011357:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1789448182.011368:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1789448182.011379:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1789448182.011390:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1789448182.011400:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789448182.011411:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1789448182.011421:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1789448182.011487:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448182.011546:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448182.011577:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e0a2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448182.014192:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275776 00000100:00100000:0.0:1789448182.014205:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275776 00000100:00100000:0.0:1789448182.014452:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789448182.014481:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448182.014641:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275776:12345-0@lo:502:mount.lustre.0 Request processed in 180us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448182.014649:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789448182.015861:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448182.015946:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1789448182.015960:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789448182.026080:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448182.026094:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026096:0:23489:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789448182.026106:0:23489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9517d3af2000 00000020:00000080:0.0:1789448182.026108:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448182.026128:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448182.026131:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026133:0:23489:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789448182.026136:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448182.026138:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026139:0:23489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789448182.026143:0:23489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9517d3af2000 00000020:00000080:0.0:1789448182.026145:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448182.026212:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448182.026216:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026217:0:23489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789448182.026220:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448182.026222:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026224:0:23489:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789448182.026227:0:23489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9517d3af2000 00000020:00000080:0.0:1789448182.026228:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448182.026258:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448182.026274:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026276:0:23489:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789448182.026279:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448182.026281:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026283:0:23489:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789448182.026285:0:23489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9517d3af2000 00000020:00000080:0.0:1789448182.026288:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789448182.026312:0:23489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448182.026315:0:23489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448182.026317:0:23489:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789448182.026320:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1789448182.026511:0:23475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789448182.026552:0:23475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448182.026579:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448182.026592:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448182.026640:0:23475:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789448182.026642:0:23475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9517d3af2000 10000000:01000000:1.0:1789448182.026645:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9517d3af2000 10000000:01000000:1.0:1789448182.026648:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789448182.026653:0:23475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9517d3af2000 from 1 10000000:01000000:1.0:1789448182.026655:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789448182.026688:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448182.026695:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448182.026705:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448182.026740:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789448182.026807:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448182.026844:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e0a2e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789448182.028248:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859275904 00000100:00100000:2.0:1789448182.028261:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859275904 00000100:00100000:2.0:1789448182.028366:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789448182.028395:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:23475:x1876371859275904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448182.028410:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448182.028424:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c7b8d800/0x6522da1199ce469b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4694 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.028448:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8d800/0x6522da1199ce469b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4694 expref: 18 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.028484:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c7b8d800/0x6522da1199ce469b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4694 expref: 18 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.028493:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b8d800, rc 0) 00000100:00100000:2.0:1789448182.028575:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859275904:12345-0@lo:101:mount.lustre.0 Request processed in 195us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448182.028581:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789448182.028667:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859275904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448182.028689:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce469b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448182.028698:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce469b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448182.030486:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1789448182.030771:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448182.030949:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1789448182.030991:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1789448182.031006:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1789448182.031020:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1789448182.031063:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1789448182.031079:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1789448182.031092:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1789448182.031103:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1789448182.031128:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1789448182.031145:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1789448182.031159:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1789448182.031171:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1789448182.031194:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1789448182.031209:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1789448182.031223:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1789448182.034382:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1789448182.034449:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1789448182.034491:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1789448182.034508:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1789448182.034522:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1789448182.034553:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1789448182.034569:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1789448182.034583:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1789448182.034598:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1789448182.034612:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1789448182.034625:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1789448182.034638:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1789448182.034650:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1789448182.034663:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1789448182.034676:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1789448182.034689:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1789448182.034702:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1789448182.034728:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1789448182.034744:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1789448182.034758:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1789448182.034771:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1789448182.034796:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1789448182.034810:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1789448182.034824:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1789448182.034836:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1789448182.034849:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1789448182.034862:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1789448182.034875:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1789448182.034889:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1789448182.034903:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1789448182.034927:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1789448182.034941:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1789448182.034955:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1789448182.038107:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1789448182.038200:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1789448182.038229:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1789448182.038385:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1789448182.038494:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448182.038554:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.038593:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448182.039221:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276032 00000100:00100000:3.0:1789448182.039230:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276032 00000100:00100000:3.0:1789448182.039968:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789448182.039984:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448182.040831:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276032:12345-0@lo:501:mount.lustre.0 Request processed in 847us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.040840:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789448182.041377:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448182.041423:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448182.041487:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.041515:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789448182.042063:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276160 00000100:00100000:2.0:1789448182.042190:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276160 00000100:00100000:2.0:1789448182.042245:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448182.042253:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448182.042361:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276160:12345-0@lo:503:mount.lustre.0 Request processed in 108us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448182.042369:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789448182.043436:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789448182.043863:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789448182.043946:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448182.044018:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.044132:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789448182.044182:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276288 00000100:00100000:2.0:1789448182.044189:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276288 00000100:00100000:2.0:1789448182.044237:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789448182.044246:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448182.044340:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276288:12345-0@lo:502:mount.lustre.0 Request processed in 95us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448182.044355:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789448182.044741:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448182.044921:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1789448182.044947:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1789448182.045143:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1789448182.045161:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1789448182.045176:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1789448182.045188:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1789448182.045202:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1789448182.045228:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1789448182.045327:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1789448182.045346:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1789448182.045362:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1789448182.045377:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1789448182.045391:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1789448182.045405:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1789448182.045420:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1789448182.045450:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1789448182.045514:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1789448182.045532:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1789448182.045545:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1789448182.045558:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1789448182.045572:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1789448182.045586:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1789448182.045600:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1789448182.045614:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1789448182.045632:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1789448182.045645:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1789448182.045658:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1789448182.045671:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1789448182.045683:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1789448182.045696:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1789448182.045710:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1789448182.045751:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1789448182.045767:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1789448182.045779:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1789448182.045793:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1789448182.045807:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1789448182.045820:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1789448182.045833:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1789448182.045846:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1789448182.045859:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1789448182.045883:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1789448182.045896:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1789448182.045911:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1789448182.045925:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1789448182.045938:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1789448182.045951:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1789448182.046980:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1789448182.047014:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1789448182.047075:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448182.047141:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.047184:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789448182.047376:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276416 00000100:00100000:3.0:1789448182.047383:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276416 00000100:00100000:3.0:1789448182.047434:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789448182.047443:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448182.047559:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276416:12345-0@lo:502:mount.lustre.0 Request processed in 117us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.047567:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789448182.047663:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448182.047818:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1789448182.047839:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1789448182.047859:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448182.047889:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.047911:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276544 00000100:00100000:0.0:1789448182.047915:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276544 00000100:00100000:0.0:1789448182.047945:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789448182.047952:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448182.048014:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276544:12345-0@lo:502:mount.lustre.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448182.048020:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789448182.048066:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789448182.048077:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789448182.048108:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1789448182.048115:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789448182.049020:0:23494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789448182.049047:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9517f82c8000) 00000020:00000080:0.0:1789448182.049067:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789448182.049142:0:23494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517d3af2000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789448182.049147:0:23494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517d3af2000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789448182.049149:0:23494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517d3af2000 3 00010000:00080000:0.0:1789448182.049177:0:23494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9517f22ca000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.138@tcp at head 00010000:00010000:0.0:1789448182.051622:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789448182.051839:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789448182.051879:0:23494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789448182.051891:0:23494:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6522da1199ce46a9 00000100:00080000:0.0:1789448182.051901:0:23494:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789448182.051913:0:23494:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9517f22ca000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448182.051948:0:23494:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770df80 x1876371859276672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789448182.051982:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3631:1876371859276672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789448182.052052:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789448182.052109:0:23494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789448182.055520:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276672 00000100:00100000:3.0:1789448182.055534:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276672 00000100:00100000:3.0:1789448182.055581:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448182.055590:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3631:x1876371859276672:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789448182.055618:0:22745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:3.0:1789448182.055654:0:22745:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6522da1199ce46b0 00000004:00100000:3.0:1789448182.055669:0:22745:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789448182.055704:0:22745:0:(import.c:65:import_set_state_nolock()) ffff9517e1572800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448182.055803:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1876371859276672:12345-0@lo:38:llog_process_th.0 Request processed in 212us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.055811:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789448182.055862:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9516c770df80 x1876371859276672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448182.055872:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789448182.055880:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789448182.055892:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789448182.055897:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789448182.055900:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f22ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789448182.055906:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3631:1876371859276672:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789448182.056787:0:23494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1789448182.056833:0:23475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789448182.056859:0:23475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789448182.056874:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce469b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448182.056886:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d90ee000/0x6522da1199ce4694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce469b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789448182.056935:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789448182.056941:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789448182.056942:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448182.056943:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448182.056944:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448182.056945:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448182.056947:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448182.056948:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448182.056950:0:23475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:1.0:1789448182.058687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448182.058695:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448182.058698:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448182.058701:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:0.0:1789448182.059177:0:23475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789448182.059184:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789448182.059185:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789448182.059187:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448182.059188:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448182.059189:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448182.059190:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448182.059192:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789448182.059193:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448182.059195:0:23475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789448182.059222:0:23475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789448182.059254:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789448182.059317:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.059354:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789448182.059382:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276800 00000100:00100000:0.0:1789448182.059389:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276800 00000100:00100000:0.0:1789448182.059430:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789448182.059438:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:23475:x1876371859276800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789448182.059482:0:22740:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789448182.059494:0:22740:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789448182.066848:0:22725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789448182.067639:0:22740:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789448182.067655:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789448182.070624:0:22760:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789448182.070635:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789448182.070660:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.070679:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.070687:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.070694:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.070751:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.070767:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448182.070781:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859276928:0@lo:104: 00000100:00100000:3.0:1789448182.070843:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448182.070894:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.070902:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 18 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448182.070927:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859277056:0@lo:104: 00000100:00100000:3.0:1789448182.070952:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448182.071422:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d2b30a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448182.071447:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859276928 00000100:00100000:3.0:1789448182.071453:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859276928 00000100:00100000:3.0:1789448182.071508:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277056 00000100:00100000:3.0:1789448182.071511:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277056 00000100:00100000:3.0:1789448182.071599:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448182.071608:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:22760:x1876371859276928:12345-0@lo:104: 00010000:00010000:3.0:1789448182.071622:0:22728:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071669:0:22728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448182.071675:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:22760:x1876371859276928:12345-0@lo:104: Request processed in 70us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.071681:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448182.071696:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448182.071701:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859277056:12345-0@lo:104: 00010000:00010000:3.0:1789448182.071708:0:22728:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071750:0:22728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789448182.071755:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859277056:12345-0@lo:104: Request processed in 55us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448182.071760:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789448182.071775:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448182.071780:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071794:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75f000 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448182.071797:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071805:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448182.071811:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448182.071815:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789448182.071844:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071849:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448182.071866:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071873:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce467f expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071886:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448182.071889:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071894:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75f800 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448182.071896:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071913:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448182.071920:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448182.071925:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789448182.071938:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.071943:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448182.071949:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.072155:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce45b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce45bb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.072167:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448182.072169:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448182.072171:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448182.072190:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:562d8d7b-adf5-44cc-8730-f8665ac1447a:3633:1876371859277312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448182.072193:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448182.072202:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859277184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448182.072222:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448182.074487:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277312 00000100:00100000:2.0:1789448182.074502:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277312 00010000:00010000:2.0:1789448182.074542:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 19 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448182.074578:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448182.074587:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:3633:x1876371859277312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448182.074601:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448182.074605:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 19 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.074615:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 19 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.074631:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448182.083309:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:23475:x1876371859276800:12345-0@lo:253:mount.lustre.0 Request processed in 23863us (23982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448182.083323:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789448182.083396:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:23475:1876371859276800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789448182.083409:0:23475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789448182.083413:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789448182.083415:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789448182.083417:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448182.083418:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448182.083419:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448182.083420:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448182.083422:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789448182.083424:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448182.083425:0:23475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789448182.083439:0:23475:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789448182.084240:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3633:x1876371859277312:12345-0@lo:103:ldlm_bl.0 Request processed in 9652us (12015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448182.084250:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448182.084283:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448182.084868:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277184 00000100:00100000:2.0:1789448182.084875:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277184 00010000:00010000:2.0:1789448182.084899:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448182.084920:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448182.084932:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3632:x1876371859277184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448182.084944:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448182.084949:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.084960:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.084979:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.084987:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789448182.085000:0:22732:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014366852s 00010000:00010000:2.0:1789448182.085005:0:22732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.085024:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448182.087440:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:562d8d7b-adf5-44cc-8730-f8665ac1447a:3633:1876371859277312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448182.087648:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477bc00/0x6522da1199ce467f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4678 expref: 18 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448182.087663:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859276928:0@lo:104: 00010000:00010000:3.0:1789448182.087676:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477aa00/0x6522da1199ce45bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce45b4 expref: 17 pid: 22740 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448182.087703:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859277056:0@lo:104: 00010000:00010000:2.0:1789448182.088217:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.088227:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.094111:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.094209:0:22760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448182.094218:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1789448182.094319:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789448182.094326:0:23499:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789448182.094330:0:23499:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789448182.095243:0:23500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789448182.095260:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00010000:00010000:2.0:1789448182.095520:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448182.095528:0:22732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.095552:0:22732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.095567:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.095576:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477b800/0x6522da1199ce46b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448182.095597:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448182.095673:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:3632:x1876371859277184:12345-0@lo:103:ldlm_bl.0 Request processed in 10738us (11385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448182.095684:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448182.095815:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859277184:0@lo:103:ldlm_bl.0 00000040:00080000:0.0:1789448182.096091:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789448182.096281:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789448182.096315:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789448182.097346:0:23475:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789448182.097359:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789448182.097419:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448182.101738:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789448182.105434:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:0.0:1789448182.106740:0:23500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789448182.106806:0:23500:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789448182.107728:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1876371859277440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789448182.107810:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.107852:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277440 00000100:00100000:0.0:1789448182.107859:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277440 00000100:00100000:0.0:1789448182.107911:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448182.107920:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23501:x1876371859277440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789448182.107988:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23501:x1876371859277440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448182.107996:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448182.108015:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448182.108047:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1876371859277440:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789448182.108074:0:23501:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789448182.108096:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1876371859277568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789448182.108124:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.108142:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277568 00000100:00100000:0.0:1789448182.108146:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277568 00000100:00100000:0.0:1789448182.108162:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448182.108167:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23501:x1876371859277568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789448182.109672:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23501:x1876371859277568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1498us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448182.109683:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448182.111117:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448182.111159:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1876371859277568:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789448182.111176:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789448182.111296:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789448182.111388:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23501:1876371859277696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789448182.111437:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448182.111476:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2600 going to sleep for 11 seconds 00080000:10000000:1.0:1789448182.111795:0:23475:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1789448182.113218:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277696 00000100:00100000:1.0:1789448182.113230:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277696 00000100:00100000:1.0:1789448182.113297:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789448182.113307:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1876371859277696:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789448182.113390:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1876371859277696:12345-0@lo:900:lod0001_rec0000.0 Request processed in 84us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448182.113396:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789448182.113449:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9516c770fb80 x1876371859277696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789448198 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448182.113476:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23501:1876371859277696:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789448182.113539:0:23501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1876371859277824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789448182.113587:0:23501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448182.113618:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277824 00000100:00100000:1.0:1789448182.113622:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277824 00000100:00100000:1.0:1789448182.113646:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789448182.113653:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1876371859277824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789448182.113706:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1876371859277824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448182.113725:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789448182.113743:0:23501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448182.113755:0:23501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1876371859277824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789448182.113803:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1789448182.116938:0:23475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789448182.120915:0:23475:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789448182.120950:0:23475:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb33cc1c2b988 00100000:10000000:0.0:1789448182.120971:0:23475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789448182.121740:0:23475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789448182.121769:0:23475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789448182.121786:0:23475:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789448182.121806:0:23475:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:1.0:1789448182.122609:0:23501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789448182.122664:0:23501:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789448182.122669:0:23501:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:3.0:1789448182.125854:0:23475:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789448182.126123:0:23475:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789448182.141954:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789448182.394801:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448182.773582:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000040:00080000:2.0:1789448183.160110:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448183.422992:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448183.799162:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 10000000:01000000:3.0:1789448183.863322:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789448183.863330:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517d3af2000 from 12 10000000:01000000:3.0:1789448183.863335:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789448183.863457:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.863484:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.863495:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448183.863521:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859277952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448183.863593:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448183.863643:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448183.863794:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859277952 00000100:00100000:1.0:1789448183.863803:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859277952 00000100:00100000:1.0:1789448183.863861:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789448183.863870:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:22742:x1876371859277952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448183.863883:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448183.863896:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce46be expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448183.863920:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce46be expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448183.863930:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46be expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448183.863938:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ef400, rc 0) 00000100:00100000:1.0:1789448183.863988:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859277952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448183.863996:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789448183.864614:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859277952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448183.864632:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.864642:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448183.864695:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859278080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789448183.864746:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448183.864774:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448183.864788:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278080 00000100:00100000:3.0:1789448183.864792:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278080 00000100:00100000:3.0:1789448183.864831:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789448183.864839:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859278080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789448183.864852:0:22740:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789448183.864866:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789448183.864870:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789448183.864945:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859278080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448183.864953:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789448183.864982:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859278080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789448183.866173:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789448183.866185:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.866206:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448183.866217:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789448183.866219:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517fb910000 from 12 10000000:01000000:3.0:1789448183.866222:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789448183.866252:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.866260:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.866270:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448183.866289:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859278208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448183.866750:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448183.866824:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789448183.870607:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278208 00000100:00100000:1.0:1789448183.870619:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278208 00000100:00100000:1.0:1789448183.870668:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789448183.870678:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859278208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448183.870693:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448183.870722:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce46cc expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448183.870941:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce46cc expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448183.870955:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46cc expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448183.870964:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ef000, rc 0) 00000100:00100000:1.0:1789448183.871037:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859278208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 361us (4702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448183.871045:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789448183.871061:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859278208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448183.871082:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448183.871093:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448183.871151:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859278336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789448183.871189:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448183.871222:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f272c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789448183.873229:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278336 00000100:00100000:2.0:1789448183.873242:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278336 00000100:00100000:2.0:1789448183.874200:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789448183.874213:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859278336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789448183.874234:0:22738:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789448183.874247:0:22738:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789448183.874250:0:22738:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789448183.874360:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859278336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448183.874368:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789448183.874595:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859278336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789448183.874647:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789448183.874656:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448183.874667:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448184.437975:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448184.825177:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00010000:00010000:2.0:1789448185.463734:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448185.847656:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000001:02000400:3.0:1789448185.980422:0:23745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg638-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789448186.488810:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789448186.761267:0:23797:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789448186.761645:0:23797:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789448186.874294:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 0 seconds 00000100:00080000:1.0:1789448187.063910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789448187.063916:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789448187.063920:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448187.063951:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9517f6031800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448187.063971:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e1880 x1876371859278592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448187.063986:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448187.063989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448187.063991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448187.063994:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448187.064012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448187.064024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448187.064026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448187.064029:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448187.064058:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859278464:0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.064122:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448187.064163:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448187.064169:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859278720:0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.064195:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448187.064229:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278464 00000100:00100000:1.0:1789448187.064236:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278464 00000100:00100000:1.0:1789448187.064276:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789448187.064284:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3634:x1876371859278464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.064328:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3634:x1876371859278464:12345-0@lo:400:kworker.0 Request processed in 44us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448187.064334:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789448187.064361:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278720 00000100:00100000:1.0:1789448187.064364:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278720 00000100:00100000:1.0:1789448187.064389:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448187.064395:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.064423:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859278720:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448187.064428:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448187.064817:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859278848:0@lo:400:kworker.0 00000100:00100000:2.0:1789448187.064851:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448187.064871:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448187.064876:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859278976:0@lo:400:kworker.0 00000100:00100000:2.0:1789448187.064901:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448187.064930:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278976 00000100:00100000:2.0:1789448187.064934:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278976 00000100:00100000:2.0:1789448187.064958:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448187.064964:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859278976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448187.064998:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859278976:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448187.065004:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789448187.065031:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9517fb9e3b80 x1876371859278976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448187.065043:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859278976:0@lo:400:kworker.0 00010000:00080000:1.0:1789448187.065234:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9517fb9e1c00 x1876371859278720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448187.065245:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859278720:0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.065266:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859278464:0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.065288:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278848 00000100:00100000:1.0:1789448187.065292:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278848 00000100:00100000:1.0:1789448187.065328:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789448187.065333:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448187.065372:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859278848:12345-0@lo:400:kworker.0 Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448187.065378:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789448187.065405:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859278848:0@lo:400:kworker.0 00000100:00100000:0.0:1789448187.065653:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859278592:0@lo:38:kworker.0 00000100:00100000:0.0:1789448187.065683:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448187.065724:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859278592 00000100:00100000:0.0:1789448187.065728:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859278592 00000100:00100000:0.0:1789448187.065748:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789448187.065752:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1876371859278592:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789448187.065773:0:22750:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1789448187.065805:0:22750:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce46da 00000004:00100000:0.0:1789448187.065818:0:22750:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789448187.065823:0:22750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789448187.065883:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448187.065891:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859279104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789448187.065939:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448187.065964:0:22749:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789448187.065971:0:22749:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789448187.066053:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279104 00000100:00100000:0.0:1789448187.066058:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279104 00000100:00100000:0.0:1789448187.066139:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448187.066146:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859279104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448187.066167:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789448187.066203:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859279104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448187.066209:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448187.066244:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859279104:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789448187.079733:0:22750:0:(import.c:65:import_set_state_nolock()) ffff9517ebd4a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448187.079832:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3631:x1876371859278592:12345-0@lo:38:kworker.0 Request processed in 14076us (14146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448187.079843:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789448187.079856:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789448187.079866:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789448187.079871:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789448187.079875:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f6031800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789448187.079888:0:3631:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000757db47b): req@ffff9517fb9e0380 x1876371859271680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448187.079905:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859278592:0@lo:38:kworker.0 00000100:00100000:3.0:1789448187.079979:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448187.080003:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efed2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789448187.080011:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859279232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448187.080020:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859271680 00000100:00100000:3.0:1789448187.080026:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859271680 00000100:00100000:1.0:1789448187.080050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448187.080060:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279232 00000100:00100000:3.0:1789448187.080063:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279232 00000100:00100000:3.0:1789448187.080082:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448187.080089:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22786:x1876371859271680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789448187.080092:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789448187.080104:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1876371859279232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448187.080149:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22786:x1876371859271680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448187.080155:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448187.080177:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22786:1876371859271680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789448187.080201:0:22786:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789448187.080229:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22786:1876371859279360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789448187.080394:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1789448187.080405:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789448187.080433:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efde8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448187.080446:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279360 00000100:00100000:3.0:1789448187.080449:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279360 00000100:00100000:3.0:1789448187.080487:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448187.080494:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22786:x1876371859279360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789448187.080602:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1876371859279232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 499us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448187.080608:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789448187.080638:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859279232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448187.080713:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22786:x1876371859279360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 218us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448187.080720:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448187.080746:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22786:1876371859279360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789448187.080802:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22786:1876371859279488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789448187.080823:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448187.080846:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efde8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448187.080911:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279488 00000100:00100000:1.0:1789448187.080916:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279488 00000100:00100000:1.0:1789448187.081509:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789448187.081526:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22786:x1876371859279488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789448187.081590:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22786:x1876371859279488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448187.081598:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448187.082820:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22786:1876371859279488:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789448187.082886:0:22786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448187.089368:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789448187.089441:0:22786:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1789448187.089446:0:22786:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1789448187.424586:0:23848:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448187.424791:0:23848:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789448187.510601:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789448188.499001:0:23896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff67fe4420 20000000:00000080:2.0:1789448188.499018:0:23896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9517f2261c00 uarg=0000000000000000 20000000:01000000:2.0:1789448188.499055:0:23896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789448188.499062:0:23896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789448188.499073:0:23896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789448188.501797:0:23897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789448188.502455:0:23896:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789448188.510642:0:23896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789448188.510670:0:23896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.510703:0:23896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4583 expref: 17 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.510712:0:23896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4686 expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.510719:0:23896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.510758:0:23896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4686 expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.510772:0:23896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4686 expref: 17 pid: 22739 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448188.510785:0:23896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23896:1876371859279616:0@lo:104: 00000100:00100000:2.0:1789448188.510841:0:23896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789448188.510901:0:23896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4583 expref: 17 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.510909:0:23896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4583 expref: 17 pid: 22738 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448188.510917:0:23896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23896:1876371859279744:0@lo:104: 00000100:00100000:2.0:1789448188.510939:0:23896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448188.510974:0:23896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c7b71f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448188.511387:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279616 00000100:00100000:0.0:1789448188.511395:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279616 00000100:00100000:0.0:1789448188.511424:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279744 00000100:00100000:0.0:1789448188.511426:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279744 00000100:00100000:0.0:1789448188.511438:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448188.511445:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:23896:x1876371859279616:12345-0@lo:104: 00010000:00010000:0.0:1789448188.511480:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511549:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448188.511555:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:23896:x1876371859279616:12345-0@lo:104: Request processed in 111us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448188.511562:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448188.511578:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448188.511592:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:23896:x1876371859279744:12345-0@lo:104: 00010000:00010000:0.0:1789448188.511600:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511635:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789448188.511640:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:23896:x1876371859279744:12345-0@lo:104: Request processed in 50us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448188.511646:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789448188.511662:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789448188.511668:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511675:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e800 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448188.511679:0:22734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511698:0:22734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448188.511704:0:22734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448188.511710:0:22734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789448188.511734:0:22734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511740:0:22734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448188.511757:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511772:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517fd75e800/0x6522da1199ce4686 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce468d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511783:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448188.511787:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511792:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e600 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448188.511796:0:22734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511803:0:22734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448188.511808:0:22734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448188.511813:0:22734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789448188.511826:0:22734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511831:0:22734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448188.511837:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511843:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517fd75e600/0x6522da1199ce4583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce458a expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.511853:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448188.511859:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448188.511861:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448188.511878:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859279872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448188.511905:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448188.511926:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789448188.511931:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859280000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448188.511947:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448188.511969:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859279872 00000100:00100000:0.0:1789448188.511973:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859279872 00010000:00010000:0.0:1789448188.511988:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4686 expref: 18 pid: 22739 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448188.512006:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280000 00000100:00100000:0.0:1789448188.512008:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280000 00010000:00010000:0.0:1789448188.512016:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4583 expref: 19 pid: 22738 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448188.512025:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448188.512029:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:3632:x1876371859279872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448188.512037:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448188.512041:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4686 expref: 19 pid: 22739 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512049:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4686 expref: 19 pid: 22739 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512062:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448188.512085:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:3632:x1876371859279872:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448188.512090:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448188.512107:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448188.512112:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3632:x1876371859280000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448188.512118:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448188.512123:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4583 expref: 18 pid: 22738 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512131:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4583 expref: 18 pid: 22738 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512141:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512147:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512159:0:22732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512166:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512171:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512177:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512181:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8de00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:0.0:1789448188.512184:0:22732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512190:0:22732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512202:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448188.512210:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448188.512230:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3632:x1876371859280000:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448188.512236:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448188.512408:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859280000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448188.512418:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859279872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789448188.512585:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448188.513160:0:23896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90eea00/0x6522da1199ce468d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4686 expref: 17 pid: 22739 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448188.513176:0:23896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23896:1876371859279616:0@lo:104: 00010000:00010000:2.0:1789448188.513187:0:23896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90ee200/0x6522da1199ce458a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4583 expref: 16 pid: 22738 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448188.513194:0:23896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23896:1876371859279744:0@lo:104: 00010000:00010000:2.0:1789448188.514389:0:23896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.514405:0:23896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.514412:0:23896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448188.514418:0:23896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce46e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448188.534812:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448189.561276:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789448190.200575:0:22742:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789448190.200582:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517d3af2000 from 13 10000000:01000000:2.0:1789448190.200587:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448190.200631:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448190.200643:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448190.200655:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448190.200697:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448190.200760:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448190.200795:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c7b71f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448190.200874:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280128 00000100:00100000:3.0:1789448190.200882:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280128 00000100:00100000:3.0:1789448190.200937:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789448190.200947:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+16:22742:x1876371859280128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448190.200959:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448190.200972:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce46e8 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448190.200995:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448190.201006:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 17 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448190.201025:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477ba00, rc 0) 00000100:00100000:3.0:1789448190.201065:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859280128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448190.201072:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789448190.201161:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448190.201175:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448190.201184:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448190.201239:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448190.201264:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448190.201781:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c7b71f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448190.204453:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280256 00000100:00100000:3.0:1789448190.205504:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280256 00000100:00100000:3.0:1789448190.205562:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789448190.205572:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859280256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448190.205732:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859280256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (4467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448190.205740:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789448190.205920:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448190.205968:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448190.206011:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448190.206045:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e02c06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448190.206098:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280384 00000100:00100000:0.0:1789448190.206103:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280384 00000100:00100000:0.0:1789448190.206137:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448190.206144:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859280384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448190.206221:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859280384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448190.206228:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789448190.206301:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789448190.207284:0:23970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789448190.208699:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789448190.208726:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789448190.208736:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448190.208748:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448190.208757:0:22742:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789448190.208760:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517fb910000 from 13 10000000:01000000:0.0:1789448190.208770:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448190.208804:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448190.208813:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448190.208824:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448190.208846:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789448190.208899:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448190.208940:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c6ac2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448190.208985:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280512 00000100:00100000:3.0:1789448190.208993:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280512 00000100:00100000:3.0:1789448190.209039:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789448190.209048:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+17:22742:x1876371859280512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448190.209059:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448190.209071:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce46f6 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448190.209092:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 18 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448190.209102:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 18 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448190.209110:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477b800, rc 0) 00000100:00100000:3.0:1789448190.209168:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859280512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448190.209175:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789448190.209249:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448190.209263:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448190.209272:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448190.209391:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448190.209417:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448190.209643:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c6ac2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448190.217638:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280640 00000100:00100000:3.0:1789448190.217652:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280640 00000100:00100000:3.0:1789448190.217725:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789448190.217736:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859280640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448190.217895:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859280640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (8476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448190.217903:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789448190.218011:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448190.218061:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448190.218109:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448190.218148:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c6ac2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789448190.218199:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280768 00000100:00100000:3.0:1789448190.218204:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280768 00000100:00100000:3.0:1789448190.218235:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789448190.218241:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859280768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448190.218396:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:22742:x1876371859280768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448190.218403:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789448190.218575:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859280768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789448190.220877:0:23971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789448190.221407:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789448190.221433:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789448190.221444:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448190.221456:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448190.585720:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448190.966223:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789448191.157681:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448181/real 1789448181] req@ffff9517e7411c00 x1876371859274880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448191 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448191.157714:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517e7411c00 x1876371859274880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448191 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448191.157725:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448181/real 1789448181] req@ffff9517e7410e00 x1876371859274624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448191 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448191.157777:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517e7410e00 x1876371859274624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448191 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789448191.157795:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789448191.157822:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789448191.157840:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859274880:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789448191.157846:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517ca4b7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789448191.157852:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789448191.157855:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859274624:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789448191.159170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448191.159176:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448191.159178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448191.159181:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448191.159219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448191.159222:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789448191.159225:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517ca4b7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448191.159231:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1789448191.159236:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789448191.159246:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9517ca4b7800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448191.159266:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770f800 x1876371859281408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789448191.159282:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448191.159285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789448191.159287:0:36:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448191.159291:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1789448191.159304:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789448191.159310:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9517fd6fd000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448191.159324:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770dc00 x1876371859281536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789448191.159358:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859281280:0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.159415:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448191.159451:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448191.159457:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859281152:0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.159508:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448191.159540:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859281280 00000100:00100000:0.0:1789448191.159546:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859281280 00000100:00100000:0.0:1789448191.159587:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789448191.159595:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859281280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.159646:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859281280:12345-0@lo:400:kworker.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448191.159653:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789448191.159689:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859281152 00000100:00100000:0.0:1789448191.159693:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859281152 00000100:00100000:0.0:1789448191.159720:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448191.159727:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.159756:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859281152:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448191.159763:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789448191.159797:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9516c770d180 x1876371859281152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448191.159810:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859281152:0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.159831:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859281280:0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.159858:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859281408:0@lo:8:kworker.0 00000400:00000100:0.0:1789448191.159882:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859281408 offset 0 length 520: 4 00000100:00100000:0.0:1789448191.159905:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859281536:0@lo:8:kworker.0 00000400:00000100:0.0:1789448191.159920:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859281536 offset 0 length 520: 4 00000100:00100000:2.0:1789448191.161257:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859281024:0@lo:400:kworker.0 00000100:00100000:2.0:1789448191.161315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448191.161364:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789448191.161371:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859280896:0@lo:400:kworker.0 00000100:00100000:2.0:1789448191.161402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448191.161433:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859281664:0@lo:400:kworker.0 00000100:00100000:2.0:1789448191.161457:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448191.161640:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859281024 00000100:00100000:0.0:1789448191.161664:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859281024 00000100:00100000:0.0:1789448191.161722:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448191.161730:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876371859281024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448191.161781:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876371859281024:12345-0@lo:400:kworker.0 Request processed in 52us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448191.161788:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448191.161824:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859281024:0@lo:400:kworker.0 00000100:00100000:1.0:1789448191.162142:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859281664 00000100:00100000:1.0:1789448191.162147:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859281664 00000100:00100000:1.0:1789448191.162189:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789448191.162197:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859281664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448191.162249:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859281664:12345-0@lo:400:kworker.0 Request processed in 53us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448191.162255:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448191.163120:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859280896 00000100:00100000:3.0:1789448191.163128:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859280896 00000100:00100000:3.0:1789448191.163176:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789448191.163184:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3635:x1876371859280896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448191.163276:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3635:x1876371859280896:12345-0@lo:400:kworker.0 Request processed in 92us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448191.163282:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789448191.164132:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859280896:0@lo:400:kworker.0 00010000:00080000:2.0:1789448191.164150:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9516c770c000 x1876371859281664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448191.164161:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859281664:0@lo:400:kworker.0 00010000:00010000:3.0:1789448191.605714:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448192.181719:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859281792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789448192.181786:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448192.182330:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859281792 00000100:00100000:0.0:1789448192.182338:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859281792 00000100:00100000:0.0:1789448192.182430:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448192.182439:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876371859281792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789448192.182498:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448192.182545:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876371859281792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448192.182551:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789448192.183366:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859281920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789448192.183405:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448192.183517:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859281792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789448192.183552:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859281920 00000100:00100000:0.0:1789448192.183557:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859281920 00000100:00100000:0.0:1789448192.183593:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789448192.183600:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859281920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448192.183649:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789448192.183884:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859281920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 283us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448192.183892:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789448192.183967:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859281920:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789448192.630726:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789448192.696634:0:23476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789448193.207689:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448178/real 1789448178] req@ffff9517fb9e3100 x1876371859272704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448193.207722:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517fb9e3100 x1876371859272704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448193.207732:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448178/real 1789448178] req@ffff9517fb9e3800 x1876371859272832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448193.207744:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517fb9e3800 x1876371859272832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789448193.207761:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448193.207778:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789448193.207782:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272704:0@lo:8:kworker.0 00000100:00080000:2.0:1789448193.207787:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448193.207792:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789448193.207795:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859272832:0@lo:8:kworker.0 00000100:00100000:1.0:1789448193.209449:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448193.209497:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859282048:0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.209555:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.209601:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859282048 00000100:00100000:1.0:1789448193.209608:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859282048 00000100:00100000:1.0:1789448193.209672:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789448193.209680:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3632:x1876371859282048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.209726:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:3632:x1876371859282048:12345-0@lo:400:kworker.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.209741:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789448193.209785:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859282048:0@lo:400:kworker.0 00000100:00080000:1.0:1789448193.209819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448193.209824:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789448193.209826:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448193.209831:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1789448193.209835:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789448193.209842:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9517f77a0000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448193.209852:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859282176:0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.209920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.209958:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e1500 x1876371859282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448193.209974:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448193.209978:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789448193.209979:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789448193.209983:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1789448193.209985:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789448193.209990:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9517fda0d000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448193.210002:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e3800 x1876371859282432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789448193.210025:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448193.210032:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859282560:0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.210058:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.210091:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859282304:0@lo:8:kworker.0 00000400:00000100:1.0:1789448193.210111:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859282304 offset 0 length 520: 4 00000100:00100000:1.0:1789448193.210123:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859282432:0@lo:8:kworker.0 00000400:00000100:1.0:1789448193.210140:0:3631:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876371859282432 offset 0 length 520: 4 00000100:00080000:1.0:1789448193.210170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448193.210174:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789448193.210177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789448193.210180:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448193.210200:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859282688:0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.210224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.210238:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448193.210244:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859282816:0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.210264:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448193.210287:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859282560 00000100:00100000:1.0:1789448193.210291:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859282560 00000100:00100000:1.0:1789448193.210329:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859282816 00000100:00100000:1.0:1789448193.210332:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859282816 00000100:00100000:1.0:1789448193.210347:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448193.210352:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859282560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.210389:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859282560:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.210395:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448193.210407:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448193.210413:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859282816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448193.210442:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859282816:12345-0@lo:400:kworker.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448193.210454:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789448193.210503:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9517fb9e3100 x1876371859282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448193.210514:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859282560:0@lo:400:kworker.0 00010000:00080000:1.0:1789448193.210537:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9517fb9e1880 x1876371859282816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448193.210545:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859282816:0@lo:400:kworker.0 00000100:00100000:0.0:1789448193.211667:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859282176 00000100:00100000:0.0:1789448193.211676:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859282176 00000100:00100000:0.0:1789448193.211706:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859282688 00000100:00100000:0.0:1789448193.211708:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859282688 00000100:00100000:0.0:1789448193.211720:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789448193.211727:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859282176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448193.211780:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859282176:12345-0@lo:400:kworker.0 Request processed in 53us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.211786:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789448193.211798:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448193.211803:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859282688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448193.211828:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859282688:12345-0@lo:400:kworker.0 Request processed in 25us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448193.211833:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448193.211865:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859282176:0@lo:400:kworker.0 00000100:00100000:0.0:1789448193.211884:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859282688:0@lo:400:kworker.0 00000040:00080000:3.0:1789448193.401403:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789448193.657313:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789448194.524823:0:24244:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789448194.524827:0:24244:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789448194.524829:0:24244:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789448194.524936:0:24244:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9517e1570000 00000020:01000004:2.0:1789448194.524956:0:24244:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789448194.524975:0:24244:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789448194.524987:0:24244:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9517f223b380) 00000020:00000080:2.0:1789448194.525001:0:24244:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789448194.616239:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789448194.618957:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789448194.625405:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789448194.625726:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789448194.625961:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789448194.626401:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789448194.626957:0:24244:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1789448194.634862:0:24244:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789448194.635085:0:24244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789448194.635097:0:24244:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789448194.635108:0:24244:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6522da1199ce470b 00000020:01000004:1.0:1789448194.635115:0:24244:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789448194.635136:0:24244:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789448194.635139:0:24244:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789448194.635144:0:24244:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789448194.635149:0:24244:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789448194.635159:0:24244:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9517f93919c0) 00000020:00000080:1.0:1789448194.635170:0:24244:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789448194.637195:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448194.639553:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789448194.639562:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789448194.639975:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789448194.639983:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789448194.640136:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789448194.640142:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789448194.644533:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789448194.644714:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789448194.644720:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789448194.653340:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789448194.653355:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1789448194.677676:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448194.678059:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789448194.678750:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789448194.678757:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789448194.680077:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789448194.680087:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789448194.681912:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789448194.681924:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789448194.690427:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448194.690711:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789448194.690725:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789448194.691761:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789448194.691770:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789448194.745971:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789448194.748182:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789448194.748235:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789448194.751167:0:24244:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789448194.751210:0:24244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789448194.752526:0:24244:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789448194.752554:0:24244:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789448194.752560:0:24244:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789448194.772218:0:24244:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789448194.773028:0:24244:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.138@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789448194.773034:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789448194.773036:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789448194.773037:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448194.773038:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448194.773040:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448194.773041:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448194.773043:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448194.773044:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448194.773045:0:24244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789448194.773050:0:24244:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789448194.773052:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789448194.773053:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789448194.773055:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448194.773056:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448194.773057:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448194.773058:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448194.773059:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448194.773133:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448194.773134:0:24244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789448194.773162:0:24244:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789448194.773183:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859282944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789448194.773665:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.773711:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.773957:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859282944 00000100:00100000:1.0:1789448194.773965:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859282944 00000100:00100000:1.0:1789448194.774036:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448194.774045:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c69d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:24244:x1876371859282944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789448194.774083:0:22739:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789448194.774086:0:22739:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789448194.774090:0:22739:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789448194.775732:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c69d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:24244:x1876371859282944:12345-0@lo:253:mount.lustre.0 Request processed in 1682us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.775744:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789448194.775862:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859282944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789448194.775876:0:24244:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789448194.775879:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789448194.775881:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789448194.775882:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789448194.775883:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789448194.775896:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789448194.775897:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789448194.775899:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789448194.775900:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789448194.775901:0:24244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789448194.775919:0:24244:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9517e1570000 from lustre-OST0000 10000000:01000000:0.0:1789448194.775947:0:24244:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789448194.775951:0:24244:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789448194.775958:0:24244:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9516c6734d40 local copy 00010000:00010000:0.0:1789448194.775980:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.776085:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448194.776119:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.776153:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.776407:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283072 00000100:00100000:1.0:1789448194.776414:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283072 00000100:00100000:1.0:1789448194.776455:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448194.776494:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c69d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:24244:x1876371859283072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448194.776564:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c69d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:24244:x1876371859283072:12345-0@lo:501:mount.lustre.0 Request processed in 72us (443us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789448194.776571:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789448194.776736:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283072:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789448194.776749:0:24244:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789448194.776764:0:24244:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789448194.776771:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.776780:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448194.776800:0:24244:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9517e1570000 10000000:01000000:0.0:1789448194.776804:0:24244:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789448194.776808:0:24244:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789448194.776810:0:24244:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448194.776814:0:24244:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789448194.776817:0:24244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789448194.776834:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.776848:0:24244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.776856:0:24244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.776868:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448194.776896:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.776913:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.778605:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283200 00000100:00100000:1.0:1789448194.778619:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283200 00000100:00100000:1.0:1789448194.778692:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448194.778702:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+18:24244:x1876371859283200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448194.778716:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448194.778732:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90ee400/0x6522da1199ce4720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4719 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448194.778758:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ee400/0x6522da1199ce4720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4719 expref: 19 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448194.778782:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90ee400/0x6522da1199ce4720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4719 expref: 19 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448194.778791:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ee400, rc 0) 00000100:00100000:1.0:1789448194.778860:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283200:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.778867:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789448194.779141:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448194.779157:0:24244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4720 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.779165:0:24244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4720 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448194.780526:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1789448194.781519:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448194.787239:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789448194.787306:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789448194.787325:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789448194.787341:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789448194.787359:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789448194.787375:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789448194.787397:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789448194.787429:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789448194.787445:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1789448194.787495:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1789448194.787524:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1789448194.787538:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1789448194.787565:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1789448194.787571:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1789448194.787676:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448194.787740:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.787775:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.788724:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283328 00000100:00100000:1.0:1789448194.788734:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283328 00000100:00100000:1.0:1789448194.788791:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789448194.788800:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448194.788993:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283328:12345-0@lo:501:mount.lustre.0 Request processed in 194us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.789001:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789448194.789248:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448194.789304:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448194.789348:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448194.789386:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.789508:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283456 00000100:00100000:1.0:1789448194.789513:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283456 00000100:00100000:1.0:1789448194.789547:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789448194.789554:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448194.790502:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283456:12345-0@lo:503:mount.lustre.0 Request processed in 945us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.790511:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789448194.790868:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789448194.791742:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448194.792229:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.792360:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448194.792401:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.792524:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283584 00000100:00100000:1.0:1789448194.792531:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283584 00000100:00100000:1.0:1789448194.792577:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789448194.792585:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448194.793307:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283584:12345-0@lo:502:mount.lustre.0 Request processed in 720us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.793326:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789448194.793427:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448194.793694:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789448194.793722:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789448194.793737:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789448194.793748:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789448194.793759:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789448194.793772:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789448194.793785:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789448194.793798:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789448194.793810:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789448194.793824:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789448194.793854:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789448194.793872:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789448194.793902:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.793951:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448194.793991:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448194.795278:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283712 00000100:00100000:1.0:1789448194.795288:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283712 00000100:00100000:1.0:1789448194.795338:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789448194.795348:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448194.795503:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283712:12345-0@lo:502:mount.lustre.0 Request processed in 156us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.795511:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789448194.796114:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789448194.796213:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1789448194.796227:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789448194.797335:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789448194.797344:0:24261:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789448194.797350:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448194.797352:0:24261:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789448194.797359:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789448194.797373:0:24261:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9516c642cd40) 00000020:00000080:3.0:1789448194.797396:0:24261:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789448194.797402:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789448194.797526:0:24261:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517e1570000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789448194.797534:0:24261:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789448194.797541:0:24261:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6522da1199ce472e 00010000:00010000:3.0:1789448194.802955:0:24261:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789448194.803727:0:24261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1789448194.805728:0:24261:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1789448194.806970:0:24261:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789448194.806981:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.806987:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.806990:0:24261:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789448194.806993:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789448194.806996:0:24261:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1789448194.806997:0:24261:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789448194.806999:0:24261:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789448194.807000:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789448194.807003:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.807004:0:24261:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789448194.807007:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448194.807010:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.807011:0:24261:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789448194.807014:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789448194.807016:0:24261:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789448194.807018:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.807020:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.807022:0:24261:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789448194.807024:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448194.807026:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.807027:0:24261:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789448194.807030:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789448194.807128:0:24261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.807133:0:24261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.807134:0:24261:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789448194.807137:0:24261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1789448194.810447:0:24244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789448194.810519:0:24244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789448194.810537:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4720 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.810549:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75f000/0x6522da1199ce4719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4720 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448194.810556:0:24244:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517e1570000 from 1 10000000:01000000:3.0:1789448194.810559:0:24244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448194.810593:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.810600:0:24244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.810610:0:24244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448194.810634:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789448194.810707:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.810745:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.810868:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283840 00000100:00100000:2.0:1789448194.810876:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283840 00000100:00100000:2.0:1789448194.810926:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789448194.810935:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517dab15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:24244:x1876371859283840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448194.810948:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448194.810961:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4735 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448194.811219:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4735 expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448194.811230:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4735 expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448194.811238:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b8c400, rc 0) 00000100:00100000:2.0:1789448194.811295:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517dab15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859283840:12345-0@lo:101:mount.lustre.0 Request processed in 362us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.811301:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789448194.811430:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448194.811446:0:24244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.811455:0:24244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448194.812942:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789448194.813400:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789448194.813736:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789448194.813762:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789448194.813776:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789448194.813791:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789448194.813803:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789448194.813816:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789448194.813829:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789448194.814406:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789448194.814432:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789448194.814449:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789448194.814496:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789448194.814521:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789448194.814527:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789448194.814610:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448194.814680:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.814716:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.816207:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859283968 00000100:00100000:2.0:1789448194.816219:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859283968 00000100:00100000:2.0:1789448194.816282:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789448194.816292:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859283968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448194.816429:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859283968:12345-0@lo:501:mount.lustre.0 Request processed in 138us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.816437:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789448194.817243:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859283968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448194.817302:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789448194.817352:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.817390:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.817511:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284096 00000100:00100000:2.0:1789448194.817523:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284096 00000100:00100000:2.0:1789448194.817557:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789448194.817565:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448194.817667:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284096:12345-0@lo:503:mount.lustre.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.817675:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789448194.817876:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789448194.818455:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789448194.818565:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448194.818603:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.818631:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.818761:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284224 00000100:00100000:2.0:1789448194.818766:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284224 00000100:00100000:2.0:1789448194.818800:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789448194.818807:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.818900:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284224:12345-0@lo:502:mount.lustre.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.818908:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789448194.819365:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789448194.819578:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789448194.819610:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789448194.819625:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789448194.819638:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789448194.819665:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789448194.819684:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789448194.819701:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789448194.819718:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789448194.819733:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789448194.819749:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789448194.819765:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789448194.819792:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448194.819833:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.819876:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.821415:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284352 00000100:00100000:2.0:1789448194.821432:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284352 00000100:00100000:2.0:1789448194.821498:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789448194.821508:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.821665:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284352:12345-0@lo:502:mount.lustre.0 Request processed in 159us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.821673:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789448194.822085:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448194.822163:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1789448194.822176:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789448194.824834:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448194.824845:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.824847:0:24265:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789448194.824854:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9517e1570000 00000020:00000080:1.0:1789448194.824856:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448194.824863:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.824865:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.824866:0:24265:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789448194.824868:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448194.824870:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.824871:0:24265:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789448194.824874:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9517e1570000 00000020:00000080:1.0:1789448194.824876:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448194.824927:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.824932:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.824933:0:24265:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789448194.824935:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448194.824937:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.824939:0:24265:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789448194.824942:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9517e1570000 00000020:00000080:1.0:1789448194.824944:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448194.824961:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.824964:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.824965:0:24265:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789448194.825517:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789448194.825523:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.825530:0:24265:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789448194.825535:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9517e1570000 00000020:00000080:1.0:1789448194.825538:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789448194.825568:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789448194.825572:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789448194.825573:0:24265:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789448194.825576:0:24265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1789448194.826695:0:24244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789448194.826729:0:24244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789448194.826754:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.826766:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448194.826815:0:24244:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789448194.826818:0:24244:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9517e1570000 10000000:01000000:0.0:1789448194.826821:0:24244:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9517e1570000 10000000:01000000:0.0:1789448194.826825:0:24244:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789448194.826830:0:24244:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9517e1570000 from 1 10000000:01000000:0.0:1789448194.826832:0:24244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789448194.826867:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.826875:0:24244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.826885:0:24244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.826907:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789448194.827764:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.827803:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448194.828605:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284480 00000100:00100000:0.0:1789448194.828614:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284480 00000100:00100000:0.0:1789448194.828669:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789448194.828678:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:24244:x1876371859284480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789448194.828692:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448194.828705:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517fd75ea00/0x6522da1199ce474a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4743 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.828728:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd75ea00/0x6522da1199ce474a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4743 expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.828740:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517fd75ea00/0x6522da1199ce474a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4743 expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.828749:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd75ea00, rc 0) 00000100:00100000:0.0:1789448194.828808:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284480:12345-0@lo:101:mount.lustre.0 Request processed in 132us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448194.828815:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789448194.829079:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448194.829096:0:24244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce474a expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448194.829105:0:24244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce474a expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448194.835367:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789448194.835732:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448194.835925:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789448194.835951:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789448194.835963:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789448194.835975:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789448194.836007:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789448194.836021:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789448194.836035:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789448194.836049:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789448194.836061:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789448194.836074:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789448194.836087:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789448194.836099:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789448194.836111:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789448194.836124:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789448194.836137:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789448194.836164:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789448194.836187:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789448194.836199:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789448194.836213:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789448194.836225:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789448194.836237:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789448194.836250:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789448194.837373:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789448194.837407:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789448194.838366:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789448194.838398:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789448194.838413:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789448194.839137:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789448194.839152:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789448194.839164:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789448194.839181:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789448194.839208:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789448194.839221:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789448194.839232:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789448194.839242:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789448194.839253:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789448194.839275:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789448194.839288:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789448194.839298:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789448194.839309:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789448194.839320:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789448194.839331:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789448194.839343:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789448194.839355:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789448194.839366:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789448194.839377:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789448194.839388:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789448194.839412:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789448194.839599:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789448194.839623:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789448194.839637:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789448194.839641:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789448194.839745:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448194.839804:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448194.839841:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c8030240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.841487:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284608 00000100:00100000:2.0:1789448194.841499:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284608 00000100:00100000:2.0:1789448194.841564:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789448194.841574:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448194.841741:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284608:12345-0@lo:501:mount.lustre.0 Request processed in 168us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.841758:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789448194.841911:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448194.841955:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789448194.842007:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448194.842040:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c8030240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.842622:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284736 00000100:00100000:2.0:1789448194.842629:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284736 00000100:00100000:2.0:1789448194.842667:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789448194.842674:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448194.842770:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284736:12345-0@lo:503:mount.lustre.0 Request processed in 96us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.842777:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789448194.842867:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789448194.843451:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789448194.843674:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448194.843721:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448194.843799:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c80306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.852131:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284864 00000100:00100000:2.0:1789448194.852146:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284864 00000100:00100000:2.0:1789448194.852199:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789448194.852209:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.852433:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284864:12345-0@lo:502:mount.lustre.0 Request processed in 225us (8711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.852441:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789448194.852609:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448194.852832:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789448194.852863:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789448194.852879:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789448194.852893:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789448194.852905:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789448194.852916:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789448194.852927:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789448194.852956:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789448194.853054:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789448194.853074:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789448194.853088:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789448194.853114:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789448194.853130:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789448194.853144:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789448194.853158:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789448194.853171:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789448194.853182:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789448194.853195:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789448194.853209:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789448194.853223:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789448194.853238:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789448194.853251:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789448194.853589:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789448194.853628:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789448194.853643:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789448194.853668:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789448194.853684:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789448194.853695:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789448194.853707:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789448194.853719:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789448194.853730:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789448194.853745:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789448194.853757:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789448194.853770:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789448194.853782:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789448194.853795:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789448194.853808:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789448194.853819:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789448194.853831:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789448194.853857:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789448194.853874:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789448194.853888:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789448194.853902:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789448194.853913:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789448194.853936:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789448194.853948:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789448194.853960:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789448194.855416:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789448194.855559:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448194.855629:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448194.855686:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.856068:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859284992 00000100:00100000:2.0:1789448194.856077:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859284992 00000100:00100000:2.0:1789448194.856120:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789448194.856129:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.856243:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859284992:12345-0@lo:502:mount.lustre.0 Request processed in 114us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.856250:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789448194.857137:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859284992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448194.858089:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789448194.858129:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789448194.858165:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859285120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789448194.858219:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448194.859639:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.864997:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285120 00000100:00100000:2.0:1789448194.865011:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285120 00000100:00100000:2.0:1789448194.865059:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789448194.865069:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859285120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448194.865219:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859285120:12345-0@lo:502:mount.lustre.0 Request processed in 151us (6999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.865227:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789448194.867146:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859285120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789448194.867233:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789448194.867247:0:24244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789448194.868637:0:24271:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789448194.868664:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9517f9393380) 00000020:00000080:1.0:1789448194.868687:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789448194.868784:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517e1570000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789448194.868789:0:24271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517e1570000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789448194.868791:0:24271:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517e1570000 3 00010000:00080000:1.0:1789448194.868820:0:24271:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9516c7701000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.138@tcp at head 00010000:00010000:1.0:1789448194.874233:0:24271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789448194.874516:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789448194.874559:0:24271:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789448194.874584:0:24271:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6522da1199ce4758 00000100:00080000:1.0:1789448194.874593:0:24271:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789448194.874609:0:24271:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9516c7701000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448194.874640:0:24271:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e1880 x1876371859285248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448194.874736:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3631:1876371859285248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448194.874791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448194.874870:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285248 00000100:00100000:1.0:1789448194.874876:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285248 00000100:00100000:1.0:1789448194.874903:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789448194.874910:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3631:x1876371859285248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789448194.874929:0:22746:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:1.0:1789448194.875039:0:22746:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6522da1199ce475f 00000004:00100000:1.0:1789448194.875054:0:22746:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789448194.875082:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9516c806f800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789448194.879199:0:24271:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789448194.880187:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448194.880192:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448194.880195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448194.880198:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448194.880223:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448194.880226:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789448194.880228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448194.880231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789448194.880274:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859285376:0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880335:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.880365:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789448194.880371:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859285504:0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880394:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.880440:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859285632:0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880485:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.880504:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448194.880510:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859285760:0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880531:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448194.880567:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285376 00000100:00100000:3.0:1789448194.880574:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285376 00000100:00100000:3.0:1789448194.880614:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285632 00000100:00100000:3.0:1789448194.880617:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285632 00000100:00100000:3.0:1789448194.880633:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448194.880641:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859285376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880702:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859285376:12345-0@lo:400:kworker.0 Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448194.880708:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448194.880724:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448194.880730:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880760:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859285632:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448194.880765:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789448194.880783:0:22745:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448194.880790:0:22745:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789448194.880807:0:22744:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448194.880813:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285504 00000100:00100000:3.0:1789448194.880817:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285504 00000100:00100000:3.0:1789448194.880831:0:22744:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448194.880835:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285760 00000100:00100000:3.0:1789448194.880837:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285760 00000100:00100000:3.0:1789448194.880845:0:22744:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448194.880851:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448194.880864:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859285504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880893:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859285504:12345-0@lo:400:kworker.0 Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448194.880899:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448194.880910:0:22744:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448194.880915:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448194.880920:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859285760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.880944:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859285760:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448194.880949:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000004:0.0:1789448194.881248:0:24271:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789448194.881272:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9517f82ccd40) 00000020:00000080:0.0:1789448194.881294:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789448194.881368:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9517e1570000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789448194.881373:0:24271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9517e1570000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789448194.881375:0:24271:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9517e1570000 3 00010000:00080000:0.0:1789448194.881401:0:24271:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9516c7a84800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.138@tcp at head 00010000:00080000:3.0:1789448194.883282:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9516c82f1c00 x1876371859285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448194.883303:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859285760:0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.883320:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859285632:0@lo:400:kworker.0 00010000:00080000:3.0:1789448194.883370:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9516c82f0380 x1876371859285504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448194.883379:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859285504:0@lo:400:kworker.0 00000100:00100000:3.0:1789448194.883393:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859285376:0@lo:400:kworker.0 00000100:00100000:1.0:1789448194.885169:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1876371859285248:12345-0@lo:38:llog_process_th.0 Request processed in 10251us (10369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448194.885181:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789448194.886671:0:24271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789448194.887028:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789448194.887073:0:24271:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789448194.887086:0:24271:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6522da1199ce476d 00000100:00080000:0.0:1789448194.887096:0:24271:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789448194.887107:0:24271:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9516c7a84800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448194.887140:0:24271:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770d180 x1876371859285888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789448194.887155:0:24271:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789448194.887181:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448194.887185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448194.887188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448194.887190:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448194.887193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448194.887196:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448194.887198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448194.887201:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789448194.887523:0:24271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:2.0:1789448194.887718:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9517fb9e1880 x1876371859285248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448194.887730:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448194.887738:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789448194.887745:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789448194.887750:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789448194.887752:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c7701000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789448194.887760:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3631:1876371859285248:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1789448194.887774:0:24244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789448194.887799:0:24244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789448194.887823:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce474a expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448194.887833:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75f800/0x6522da1199ce4743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce474a expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789448194.887881:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789448194.887883:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448194.887885:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448194.887886:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448194.887888:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448194.887889:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448194.887894:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448194.887896:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448194.887897:0:24244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789448194.887900:0:24244:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789448194.887903:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789448194.887904:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789448194.887905:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448194.887906:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448194.887907:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448194.887908:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448194.887909:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448194.887910:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448194.887910:0:24244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789448194.887927:0:24244:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789448194.887940:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859286016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789448194.888012:0:24244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448194.888044:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d67c0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789448194.888063:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286016 00000100:00100000:2.0:1789448194.888068:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286016 00000100:00100000:2.0:1789448194.888106:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789448194.888113:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859286016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789448194.888136:0:22738:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789448194.888148:0:22738:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789448194.888386:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3631:1876371859285888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448194.888433:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448194.888487:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859285888 00000100:00100000:2.0:1789448194.888491:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859285888 00000100:00100000:2.0:1789448194.888515:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789448194.888520:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3631:x1876371859285888:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789448194.888540:0:22744:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:2.0:1789448194.888567:0:22744:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6522da1199ce4774 00000004:00100000:2.0:1789448194.888580:0:22744:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789448194.888623:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9516c783b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448194.888673:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1876371859285888:12345-0@lo:38:llog_process_th.0 Request processed in 151us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448194.888680:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789448194.888706:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9516c770d180 x1876371859285888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448194.888715:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789448194.888720:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789448194.888724:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789448194.888727:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789448194.888729:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c7a84800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789448194.888733:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3631:1876371859285888:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789448194.895646:0:22738:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789448194.895680:0:22738:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789448194.895866:0:22760:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789448194.895871:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789448194.895893:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.895910:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46be expref: 21 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.895917:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.895935:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.895984:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.895997:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.896011:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859286144:0@lo:104: 00000100:00100000:0.0:1789448194.896066:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448194.896118:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce46be expref: 21 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.896126:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce46be expref: 21 pid: 22739 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.896134:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859286272:0@lo:104: 00000100:00100000:0.0:1789448194.896156:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.896172:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448194.896194:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789448194.896210:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286144 00000100:00100000:0.0:1789448194.896216:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286144 00000100:00100000:0.0:1789448194.896245:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286272 00000100:00100000:0.0:1789448194.896247:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286272 00000100:00100000:3.0:1789448194.896430:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:24244:x1876371859286016:12345-0@lo:253:mount.lustre.0 Request processed in 8316us (8416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448194.896439:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789448194.896528:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:24244:1876371859286016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789448194.896545:0:24244:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789448194.896548:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789448194.896549:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789448194.896551:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448194.896552:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448194.896553:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448194.896554:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448194.896556:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789448194.896558:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448194.896559:0:24244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789448194.896571:0:24244:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789448194.897061:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448194.897075:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:22760:x1876371859286144:12345-0@lo:104: 00010000:00010000:0.0:1789448194.897088:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.897146:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448194.897152:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:22760:x1876371859286144:12345-0@lo:104: Request processed in 82us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448194.897198:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859286144:0@lo:104: 00000100:00100000:0.0:1789448194.900399:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448194.900432:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448194.900443:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ca3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859286272:12345-0@lo:104: 00010000:00010000:1.0:1789448194.900509:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448194.900516:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.900561:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.900642:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789448194.900658:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ca3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859286272:12345-0@lo:104: Request processed in 209us (4491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448194.900666:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789448194.900711:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789448194.902214:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859286272:0@lo:104: 00010000:00010000:2.0:1789448194.902243:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448194.902513:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477bc00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:1.0:1789448194.902519:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448194.902529:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789448194.902536:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448194.902551:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000001:00000004:0.0:1789448194.903231:0:24244:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:3.0:1789448194.903527:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.903535:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448194.903554:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.903561:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d477bc00/0x6522da1199ce46cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46d3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.903573:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448194.903575:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448194.903577:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448194.903590:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859286400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448194.904297:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789448194.904394:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448194.904396:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448194.904398:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448194.904430:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286400 00000100:00100000:0.0:1789448194.904437:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286400 00010000:00010000:0.0:1789448194.904503:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.904531:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448194.904538:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3634:x1876371859286400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448194.904551:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448194.904556:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904567:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904586:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90ef000/0x6522da1199ce46d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce46cc expref: 21 pid: 22740 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904598:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448194.904635:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:3634:x1876371859286400:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448194.904643:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789448194.904674:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448194.904680:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859286400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448194.904681:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477aa00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:0.0:1789448194.904685:0:22734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904694:0:22734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789448194.904700:0:22734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448194.904706:0:22734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789448194.904746:0:22734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904752:0:22734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789448194.904774:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904781:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d477aa00/0x6522da1199ce46be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46c5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904799:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448194.904801:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448194.904803:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448194.904823:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448194.904833:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859286528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789448194.904857:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448194.904885:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286528 00000100:00100000:0.0:1789448194.904888:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286528 00010000:00010000:0.0:1789448194.904902:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46be expref: 20 pid: 22739 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.904920:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448194.904926:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:3634:x1876371859286528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448194.904933:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448194.904937:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46be expref: 20 pid: 22739 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904946:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce46be expref: 20 pid: 22739 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904956:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90ef400/0x6522da1199ce46c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce46be expref: 20 pid: 22739 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.904967:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905007:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789448194.905293:0:22732:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014366852s 00010000:00010000:0.0:1789448194.905299:0:22732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905307:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905314:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905321:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905326:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75fe00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:0.0:1789448194.905330:0:22732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905337:0:22732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905360:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448194.905370:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789448194.905382:0:22760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.905390:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448194.905396:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce477b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448194.905410:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:3634:x1876371859286528:12345-0@lo:103:ldlm_bl.0 Request processed in 484us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448194.905416:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448194.905451:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859286528:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1789448194.906801:0:24244:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789448194.906808:0:24244:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789448194.906844:0:24244:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789448194.906894:0:24244:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789448194.906914:0:24244:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789448194.906931:0:24244:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789448194.910040:0:24244:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448194.913400:0:24244:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789448195.701731:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789448195.830165:0:24326:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448195.830377:0:24326:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789448196.666069:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789448196.666076:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517d3af2000 from 13 10000000:01000000:0.0:1789448196.666082:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789448196.666121:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448196.666133:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448196.666144:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448196.666168:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859286656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789448196.666227:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448196.666266:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517c3c89240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448196.668164:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286656 00000100:00100000:2.0:1789448196.668178:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286656 00000100:00100000:2.0:1789448196.668241:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789448196.668252:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+19:22742:x1876371859286656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448196.668267:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448196.668284:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4782 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.668310:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4782 expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.668340:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4782 expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.668349:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b8c800, rc 0) 00000100:00100000:2.0:1789448196.668420:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:22742:x1876371859286656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448196.668427:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789448196.668493:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859286656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448196.668510:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.668520:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448196.668578:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859286784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789448196.668611:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448196.668636:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82daa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448196.669556:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286784 00000100:00100000:0.0:1789448196.669563:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286784 00000100:00100000:0.0:1789448196.669601:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789448196.669610:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:22742:x1876371859286784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789448196.669626:0:22739:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789448196.669653:0:22739:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789448196.669656:0:22739:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789448196.669740:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:22742:x1876371859286784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448196.669756:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789448196.670150:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859286784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789448196.670211:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448196.670220:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.670231:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448196.670241:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789448196.670249:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517fb910000 from 13 10000000:01000000:2.0:1789448196.670252:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789448196.670275:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.670283:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.670292:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448196.670309:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859286912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448196.670340:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448196.671097:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82daa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448196.677417:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859286912 00000100:00100000:0.0:1789448196.677431:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859286912 00000100:00100000:0.0:1789448196.677498:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789448196.677509:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:22742:x1876371859286912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448196.677523:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448196.677540:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4790 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448196.677568:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4790 expref: 21 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448196.677580:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4790 expref: 21 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448196.677589:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd75fe00, rc 0) 00000100:00100000:0.0:1789448196.677670:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859286912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (7328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448196.677677:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789448196.678035:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859286912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448196.678054:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.678065:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448196.678129:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859287040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789448196.678169:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448196.678207:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82daa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448196.678555:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287040 00000100:00100000:3.0:1789448196.678561:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287040 00000100:00100000:3.0:1789448196.678601:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789448196.678609:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859287040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789448196.678624:0:22738:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789448196.678651:0:22738:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789448196.678655:0:22738:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789448196.678735:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859287040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448196.678743:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789448196.680137:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859287040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789448196.680201:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448196.680211:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448196.680233:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448196.730239:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448197.305649:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859287168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448197.305715:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448197.305768:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287168 00000100:00100000:2.0:1789448197.305776:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287168 00000100:00100000:2.0:1789448197.305820:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789448197.305829:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859287168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789448197.305862:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789448197.305909:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859287168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448197.305917:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789448197.306058:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859287168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789448197.311730:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859287296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789448197.311789:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448197.311856:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287296 00000100:00100000:0.0:1789448197.311862:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287296 00000100:00100000:0.0:1789448197.311912:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448197.311921:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859287296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789448197.311949:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448197.312041:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859287296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448197.312055:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448197.312097:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859287296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789448197.751194:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448198.777192:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448199.797736:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789448200.182573:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1789448200.373679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448200.373686:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448200.373688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448200.373691:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448200.373715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448200.373718:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448200.373721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448200.373724:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789448200.373763:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859287680:0@lo:400:kworker.0 00000100:00100000:0.0:1789448200.373825:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448200.373854:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859288192:0@lo:400:kworker.0 00000100:00100000:0.0:1789448200.373879:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448200.374108:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859287424:0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.374144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448200.374170:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859287936:0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.374193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448200.374222:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789448200.374228:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859287552:0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.374251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448200.374271:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859288064:0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.374292:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448200.374317:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287680 00000100:00100000:1.0:1789448200.374324:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287680 00000100:00100000:1.0:1789448200.374357:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288192 00000100:00100000:1.0:1789448200.374359:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288192 00000100:00100000:1.0:1789448200.374383:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287936 00000100:00100000:1.0:1789448200.374385:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287936 00000100:00100000:1.0:1789448200.374395:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288064 00000100:00100000:1.0:1789448200.374397:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288064 00000100:00100000:1.0:1789448200.374412:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448200.374420:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859287680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.374498:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859287680:12345-0@lo:400:kworker.0 Request processed in 78us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448200.374515:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448200.374534:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448200.374539:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859288192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448200.374682:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287424 00000100:00100000:3.0:1789448200.374686:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287424 00000100:00100000:3.0:1789448200.374717:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789448200.374723:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3634:x1876371859287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448200.374763:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3634:x1876371859287424:12345-0@lo:400:kworker.0 Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448200.374769:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789448200.374822:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859287424:0@lo:400:kworker.0 00000100:00100000:2.0:1789448200.375175:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448200.375184:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859287936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448200.375223:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859287936:12345-0@lo:400:kworker.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448200.375229:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448200.375242:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448200.375248:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859288064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448200.375274:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859288064:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448200.375280:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789448200.376396:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c770d180 x1876371859288064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448200.376410:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859288064:0@lo:400:kworker.0 00010000:00080000:3.0:1789448200.376423:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c770ed80 x1876371859287936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448200.376431:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859287936:0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.377783:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859288192:12345-0@lo:400:kworker.0 Request processed in 3237us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448200.377795:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448200.377844:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287552 00000100:00100000:1.0:1789448200.377851:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287552 00000100:00100000:1.0:1789448200.378018:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789448200.378027:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859287552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448200.378098:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859287552:12345-0@lo:400:kworker.0 Request processed in 72us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448200.378105:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789448200.381218:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c7969180 x1876371859288192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448200.381236:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859288192:0@lo:400:kworker.0 00000100:00100000:0.0:1789448200.381270:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859287808:0@lo:400:kworker.0 00000100:00100000:0.0:1789448200.381322:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789448200.381675:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c770ce00 x1876371859287680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448200.381695:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859287680:0@lo:400:kworker.0 00000100:00080000:0.0:1789448200.382909:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448200.382916:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789448200.383347:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859287808 00000100:00100000:3.0:1789448200.383357:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859287808 00000100:00100000:3.0:1789448200.383400:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448200.383408:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859287808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448200.383552:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859287808:12345-0@lo:400:kworker.0 Request processed in 144us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448200.383559:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448200.383697:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859287552:0@lo:400:kworker.0 00000100:00100000:0.0:1789448200.383824:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859287808:0@lo:400:kworker.0 00000001:02000400:0.0:1789448200.626408:0:24616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg638-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789448200.821705:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789448201.783228:0:24668:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448201.783420:0:24668:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789448201.848364:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448202.421703:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859288320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789448202.421778:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448202.421939:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859288448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448202.421977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448202.422054:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288320 00000100:00100000:0.0:1789448202.422061:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288320 00000100:00100000:0.0:1789448202.422110:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288448 00000100:00100000:0.0:1789448202.422114:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288448 00000100:00100000:0.0:1789448202.422129:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448202.422137:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859288320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789448202.422170:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448202.422214:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859288320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448202.422220:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789448202.422236:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789448202.422241:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859288448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448202.422257:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789448202.422282:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859288448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448202.422287:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789448202.422442:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859288448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448202.422495:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859288320:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789448202.849290:0:24718:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448202.849930:0:24718:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789448202.893712:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789448203.642822:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789448203.899741:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448204.920510:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789448205.503342:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448205.503348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448205.503351:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448205.503354:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448205.503367:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448205.503370:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448205.503372:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448205.503375:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789448205.503420:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859288960:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.503620:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.503707:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789448205.503713:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859288576:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.503750:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.503771:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859289088:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.503790:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.503818:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859288704:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.503837:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.511707:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859289216:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.511774:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.511801:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789448205.511808:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859288832:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.511830:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.511848:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859289344:0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.511867:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448205.511895:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288576 00000100:00100000:2.0:1789448205.511903:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288576 00000100:00100000:2.0:1789448205.511957:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789448205.511966:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3634:x1876371859288576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.512015:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3634:x1876371859288576:12345-0@lo:400:kworker.0 Request processed in 51us (8264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448205.512021:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789448205.512050:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289088 00000100:00100000:2.0:1789448205.512054:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289088 00000100:00100000:2.0:1789448205.512071:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289216 00000100:00100000:2.0:1789448205.512074:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289216 00000100:00100000:2.0:1789448205.512096:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288832 00000100:00100000:2.0:1789448205.512099:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288832 00000100:00100000:2.0:1789448205.512108:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289344 00000100:00100000:2.0:1789448205.512110:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289344 00000100:00100000:2.0:1789448205.512124:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448205.512130:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859289088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.512160:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859289088:12345-0@lo:400:kworker.0 Request processed in 30us (8368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448205.512177:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789448205.512189:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448205.512195:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859289216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.512228:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859289216:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448205.512233:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448205.512244:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448205.512251:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859288832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.512277:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859288832:12345-0@lo:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448205.512283:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448205.512294:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448205.512300:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859289344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448205.512324:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859289344:12345-0@lo:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448205.512329:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789448205.512363:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859288576:0@lo:400:kworker.0 00010000:00080000:2.0:1789448205.512378:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83af480 x1876371859289088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448205.512389:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859289088:0@lo:400:kworker.0 00000100:00080000:2.0:1789448205.512413:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789448205.512417:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789448205.512429:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9517e7411180 x1876371859288832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448205.512486:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859288832:0@lo:400:kworker.0 00010000:00080000:2.0:1789448205.512499:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83ac700 x1876371859289344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448205.512506:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859289344:0@lo:400:kworker.0 00010000:00080000:2.0:1789448205.512514:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83ac000 x1876371859289216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448205.512522:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859289216:0@lo:400:kworker.0 00000100:00100000:3.0:1789448205.516614:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288960 00000100:00100000:3.0:1789448205.516628:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288960 00000100:00100000:3.0:1789448205.516688:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859288704 00000100:00100000:3.0:1789448205.516691:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859288704 00000100:00100000:3.0:1789448205.516709:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448205.516718:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859288960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448205.516821:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859288960:12345-0@lo:400:kworker.0 Request processed in 104us (13200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448205.516835:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448205.516852:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448205.516858:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859288704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448205.516895:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859288704:12345-0@lo:400:kworker.0 Request processed in 37us (13057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448205.516901:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448205.516960:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859288960:0@lo:400:kworker.0 00000100:00100000:3.0:1789448205.516997:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859288704:0@lo:400:kworker.0 00010000:00010000:3.0:1789448205.941762:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448206.137325:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448191/real 1789448191] req@ffff9516c770f800 x1876371859281408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448206.137354:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9516c770f800 x1876371859281408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448206.137364:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448191/real 1789448191] req@ffff9516c770dc00 x1876371859281536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448206.137375:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9516c770dc00 x1876371859281536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448206.137395:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517ca4b7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448206.137418:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789448206.137422:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859281408:0@lo:8:kworker.0 00000100:00080000:3.0:1789448206.137427:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789448206.137431:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789448206.137434:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859281536:0@lo:8:kworker.0 00000100:00080000:0.0:1789448206.137584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448206.137588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448206.137590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448206.137593:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789448206.137625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448206.137628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789448206.137630:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517ca4b7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448206.137635:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 593 00000100:00080000:0.0:1789448206.137640:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789448206.137649:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9517ca4b7800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448206.137667:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c7968700 x1876371859289984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789448206.137680:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789448206.137683:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789448206.137685:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789448206.137688:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 593 00000100:00080000:0.0:1789448206.137690:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789448206.137694:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9517fd6fd000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448206.137705:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c796aa00 x1876371859290112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789448206.137743:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859289600:0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.137797:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448206.137836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3635:1876371859290368:0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.137863:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448206.137884:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789448206.137888:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859289472:0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.137911:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448206.138072:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859289728:0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138103:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448206.138122:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859290496:0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138144:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448206.138162:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448206.138167:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859289856:0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138186:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448206.138213:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290368 00000100:00100000:3.0:1789448206.138220:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290368 00000100:00100000:3.0:1789448206.138259:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289728 00000100:00100000:3.0:1789448206.138262:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289728 00000100:00100000:3.0:1789448206.138274:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290496 00000100:00100000:3.0:1789448206.138276:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290496 00000100:00100000:3.0:1789448206.138288:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448206.138295:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876371859290368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138337:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876371859290368:12345-0@lo:400:kworker.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.138344:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789448206.138359:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448206.138364:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859289728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138392:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859289728:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.138397:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789448206.138407:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789448206.138412:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859290496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138436:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859290496:12345-0@lo:400:kworker.0 Request processed in 24us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.138448:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789448206.138488:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289600 00000100:00100000:3.0:1789448206.138492:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289600 00000100:00100000:3.0:1789448206.138514:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289856 00000100:00100000:3.0:1789448206.138517:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289856 00000100:00100000:3.0:1789448206.138529:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789448206.138534:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859289600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138581:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859289600:12345-0@lo:400:kworker.0 Request processed in 46us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.138586:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789448206.138611:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789448206.138617:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859289856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.138645:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859289856:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.138650:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789448206.138681:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859289856:0@lo:400:kworker.0 00010000:00080000:3.0:1789448206.138693:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c7969c00 x1876371859289728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448206.138701:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859289728:0@lo:400:kworker.0 00010000:00080000:3.0:1789448206.138710:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c7969f80 x1876371859290496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448206.138718:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859290496:0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.138932:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859290240:0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.138957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448206.138982:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859289600:0@lo:400:kworker.0 00010000:00080000:0.0:1789448206.138991:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c796b480 x1876371859290368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448206.138997:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3635:1876371859290368:0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.139022:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859289984:0@lo:8:kworker.0 00000100:00100000:0.0:1789448206.139045:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448206.139181:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859290112:0@lo:8:kworker.0 00000100:00100000:0.0:1789448206.139203:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448206.139688:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289472 00000100:00100000:3.0:1789448206.139695:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289472 00000100:00100000:3.0:1789448206.139741:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789448206.139749:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3635:x1876371859289472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448206.139795:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:3635:x1876371859289472:12345-0@lo:400:kworker.0 Request processed in 47us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.139801:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789448206.143841:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290240 00000100:00100000:0.0:1789448206.143854:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290240 00000100:00100000:0.0:1789448206.143905:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448206.143925:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448206.143994:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859290240:12345-0@lo:400:kworker.0 Request processed in 82us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448206.144000:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789448206.144051:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859289472:0@lo:400:kworker.0 00010000:00080000:0.0:1789448206.144075:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c796ad80 x1876371859290240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448206.144093:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859290240:0@lo:400:kworker.0 00000100:00100000:2.0:1789448206.144376:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859289984 00000100:00100000:2.0:1789448206.144382:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859289984 00000100:00100000:2.0:1789448206.144408:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290112 00000100:00100000:2.0:1789448206.144411:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290112 00000100:00100000:2.0:1789448206.144422:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448206.144427:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3631:x1876371859289984:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789448206.144453:0:24249:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:2.0:1789448206.144498:0:24249:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce479e 00002000:00100000:2.0:1789448206.144511:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9516c7839000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789448206.144515:0:24249:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789448206.144518:0:24249:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789448206.144688:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789448206.144711:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9516c783f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448206.144756:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3631:x1876371859289984:12345-0@lo:8:kworker.0 Request processed in 328us (5710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448206.144763:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448206.144790:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448206.144801:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3631:x1876371859290112:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789448206.144813:0:24249:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789448206.144840:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3631:x1876371859290112:12345-0@lo:8:kworker.0 Request processed in 38us (5636us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789448206.144845:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789448206.145671:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c7968700 x1876371859289984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448206.145683:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789448206.145690:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789448206.145698:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789448206.145703:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789448206.145705:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517ca4b7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789448206.145724:0:3631:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789448206.145729:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859289984:0@lo:8:kworker.0 00000100:00080000:0.0:1789448206.145740:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789448206.145744:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789448206.145747:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859290112:0@lo:8:kworker.0 00000004:00080000:2.0:1789448206.145905:0:23486:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x1:0x0] 00000100:00100000:2.0:1789448206.145938:0:23486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23486:1876371859290752:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789448206.145980:0:23486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448206.146000:0:23486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e02c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789448206.146013:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290752 00000100:00100000:2.0:1789448206.146018:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290752 00000100:00100000:2.0:1789448206.146190:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448206.146201:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23486:x1876371859290752:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1789448206.146391:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448206.146654:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448206.146665:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859290624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789448206.147031:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448206.147125:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290624 00000100:00100000:2.0:1789448206.147131:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290624 00000100:00100000:2.0:1789448206.147162:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789448206.147169:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3632:x1876371859290624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789448206.147191:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448206.147233:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3632:x1876371859290624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448206.147239:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789448206.147270:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83ac000 x1876371859290624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448206.147294:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859290624:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789448206.150883:0:23485:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789448206.150964:0:23485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 608368502844ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789448206.150972:0:23485:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:3.0:1789448206.154357:0:24249:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789448206.154367:0:24249:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x41:0x0] 00000100:00100000:3.0:1789448206.154454:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23486:x1876371859290752:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8252us (8470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.154484:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789448206.157801:0:23486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83ac700 x1876371859290752/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789448222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448206.157817:0:23486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23486:1876371859290752:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789448206.157831:0:23486:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000401:0x41:0x0] 00000100:00100000:2.0:1789448206.157868:0:23486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23486:1876371859290880:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789448206.157917:0:23486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448206.157957:0:23486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e02c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448206.158126:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859290880 00000100:00100000:3.0:1789448206.158132:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859290880 00000100:00100000:3.0:1789448206.158180:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789448206.158188:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23486:x1876371859290880:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789448206.158210:0:24251:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1789448206.158246:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23486:x1876371859290880:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448206.158252:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789448206.158510:0:23486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83ac700 x1876371859290880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448222 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448206.158519:0:23486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23486:1876371859290880:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789448206.158528:0:23486:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x41:0x0] 00000100:00100000:2.0:1789448206.158858:0:23486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23486:1876371859291008:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789448206.158890:0:23486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448206.158914:0:23486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e02c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789448206.158963:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291008 00000100:00100000:3.0:1789448206.158968:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291008 00000100:00100000:3.0:1789448206.159036:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789448206.159045:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23486:x1876371859291008:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789448206.159080:0:24249:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000004:00080000:3.0:1789448206.160388:0:23476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:1.0:1789448206.202329:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789448206.202344:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789448206.202633:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23486:x1876371859291008:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43585us (43738us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789448206.202643:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789448206.202827:0:23486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c83ac700 x1876371859291008/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448206.202838:0:23486:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789448206.202844:0:23486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23486:1876371859291008:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789448206.202859:0:23486:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1789448206.202906:0:23486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23486:1876371859291136:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789448206.203019:0:23486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448206.203049:0:23486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da840 going to sleep for 11 seconds 00000100:00100000:1.0:1789448206.203292:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291136 00000100:00100000:1.0:1789448206.203299:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291136 00000100:00100000:1.0:1789448206.203334:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789448206.203343:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23486:x1876371859291136:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789448206.203396:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23486:x1876371859291136:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448206.203403:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789448206.205006:0:23486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9516c796aa00 x1876371859291136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789448222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448206.205041:0:23486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23486:1876371859291136:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1789448206.965675:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448207.543016:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859291264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789448207.543093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448207.543157:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291264 00000100:00100000:3.0:1789448207.543165:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291264 00000100:00100000:3.0:1789448207.543209:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789448207.543218:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859291264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789448207.543249:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789448207.543293:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859291264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448207.543301:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789448207.543343:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859291264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789448207.545607:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859291392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789448207.545667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448207.545715:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291392 00000100:00100000:0.0:1789448207.545722:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291392 00000100:00100000:0.0:1789448207.545761:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789448207.545770:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859291392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789448207.545798:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448207.545839:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859291392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448207.545846:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789448207.564804:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859291392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789448207.991612:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448209.013651:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789448209.882042:0:25064:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789448209.882046:0:25064:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789448209.882048:0:25064:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789448209.882159:0:25064:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9516c7a84000 00000020:01000004:0.0:1789448209.882173:0:25064:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789448209.882187:0:25064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789448209.882209:0:25064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9516c813b380) 00000020:00000080:0.0:1789448209.882227:0:25064:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789448209.931699:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789448209.935328:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789448209.936330:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789448209.936754:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789448209.937008:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789448209.937326:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789448209.937823:0:25064:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1789448209.940083:0:25064:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789448209.941771:0:25064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789448209.941786:0:25064:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789448209.941799:0:25064:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6522da1199ce47ac 00000020:01000004:0.0:1789448209.941805:0:25064:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789448209.941826:0:25064:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789448209.941829:0:25064:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789448209.941834:0:25064:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789448209.941861:0:25064:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789448209.941866:0:25064:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789448209.961788:0:25064:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789448209.961825:0:25064:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.138@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789448209.961829:0:25064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789448209.961831:0:25064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789448209.961832:0:25064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448209.961834:0:25064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448209.961835:0:25064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448209.961836:0:25064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448209.961838:0:25064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448209.961839:0:25064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448209.961840:0:25064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789448209.961843:0:25064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789448209.961846:0:25064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789448209.961847:0:25064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789448209.961848:0:25064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448209.961850:0:25064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448209.961851:0:25064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448209.961852:0:25064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448209.961853:0:25064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448209.961854:0:25064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448209.961855:0:25064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789448209.961879:0:25064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789448209.961907:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291520:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789448209.961975:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448209.962013:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448209.962175:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291520 00000100:00100000:3.0:1789448209.962182:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291520 00000100:00100000:3.0:1789448209.962232:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789448209.962241:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:25064:x1876371859291520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789448209.962268:0:22738:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789448209.962271:0:22738:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789448209.962275:0:22738:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789448209.962621:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:25064:x1876371859291520:12345-0@lo:253:mount.lustre.0 Request processed in 380us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448209.962629:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789448209.962758:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291520:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789448209.962768:0:25064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789448209.962770:0:25064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789448209.962771:0:25064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789448209.962773:0:25064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789448209.962774:0:25064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789448209.962775:0:25064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789448209.962776:0:25064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789448209.962777:0:25064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789448209.962779:0:25064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789448209.962788:0:25064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789448209.962807:0:25064:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9516c7a84000 from lustre-OST0001 10000000:01000000:1.0:1789448209.962843:0:25064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789448209.962845:0:25064:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789448209.962854:0:25064:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9516c6734d40 local copy 00010000:00010000:1.0:1789448209.962863:0:25064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448209.962959:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448209.962987:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448209.963020:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80ec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448209.963273:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291648 00000100:00100000:3.0:1789448209.963278:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291648 00000100:00100000:3.0:1789448209.963313:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789448209.963321:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:25064:x1876371859291648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448209.963385:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:25064:x1876371859291648:12345-0@lo:501:mount.lustre.0 Request processed in 65us (397us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789448209.963402:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789448209.963643:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291648:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789448209.963669:0:25064:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789448209.963688:0:25064:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789448209.963695:0:25064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448209.963704:0:25064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517fd75fc00/0x6522da1199ce44c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce44cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448209.963727:0:25064:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9516c7a84000 10000000:01000000:1.0:1789448209.963731:0:25064:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789448209.963736:0:25064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789448209.963739:0:25064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789448209.963742:0:25064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789448209.963745:0:25064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789448209.963767:0:25064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448209.963776:0:25064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448209.963791:0:25064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448209.963805:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789448209.963834:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448209.963853:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80ec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448209.964160:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291776 00000100:00100000:3.0:1789448209.964166:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291776 00000100:00100000:3.0:1789448209.964200:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789448209.964207:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:25064:x1876371859291776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448209.964216:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448209.964227:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477b200/0x6522da1199ce47ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce47b3 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448209.964247:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477b200/0x6522da1199ce47ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce47b3 expref: 22 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448209.964257:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477b200/0x6522da1199ce47ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce47b3 expref: 22 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448209.964265:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477b200, rc 0) 00000100:00100000:3.0:1789448209.964297:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859291776:12345-0@lo:101:mount.lustre.0 Request processed in 91us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448209.964303:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789448209.964380:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789448209.964391:0:25064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47ba expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448209.964399:0:25064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce47ba expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448209.965598:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789448209.966353:0:25064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789448209.969224:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789448209.969277:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789448209.969294:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789448209.969307:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789448209.969325:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789448209.969337:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789448209.969350:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789448209.969364:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789448209.969375:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789448209.969398:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789448209.969403:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789448209.969530:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789448209.969595:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448209.969638:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80ec900 going to sleep for 11 seconds 00000100:00100000:0.0:1789448209.969717:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859291904 00000100:00100000:0.0:1789448209.969725:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859291904 00000100:00100000:0.0:1789448209.969772:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789448209.969780:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859291904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448209.969920:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859291904:12345-0@lo:501:mount.lustre.0 Request processed in 141us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.969928:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789448209.970022:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859291904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448209.970055:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448209.970093:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.970116:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789448209.970169:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292032 00000100:00100000:0.0:1789448209.970173:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292032 00000100:00100000:0.0:1789448209.970202:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789448209.970209:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448209.971253:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292032:12345-0@lo:503:mount.lustre.0 Request processed in 1041us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.971263:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789448209.971354:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789448209.971815:0:25064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448209.971884:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448209.971937:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.971968:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789448209.972028:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292160 00000100:00100000:0.0:1789448209.972033:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292160 00000100:00100000:0.0:1789448209.972063:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789448209.972070:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448209.972778:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292160:12345-0@lo:502:mount.lustre.0 Request processed in 706us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.972788:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789448209.972945:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448209.973132:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789448209.973159:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789448209.973175:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789448209.973190:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789448209.973204:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789448209.973217:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789448209.973230:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789448209.973243:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789448209.973257:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789448209.973282:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448209.973320:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448209.973353:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fdaa6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789448209.973424:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292288 00000100:00100000:0.0:1789448209.973441:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292288 00000100:00100000:0.0:1789448209.973497:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789448209.973505:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448209.973596:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292288:12345-0@lo:502:mount.lustre.0 Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448209.973602:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789448209.973927:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448209.973969:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789448209.973977:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789448209.980676:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789448209.980687:0:25068:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789448209.980693:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789448209.980696:0:25068:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789448209.980701:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789448209.980715:0:25068:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9517f223cd40) 00000020:00000080:2.0:1789448209.980740:0:25068:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789448209.980746:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789448209.980843:0:25068:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9516c7a84000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789448209.980851:0:25068:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789448209.980859:0:25068:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6522da1199ce47c8 00010000:00010000:2.0:1789448209.986812:0:25068:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789448209.987313:0:25068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1789448209.991332:0:25068:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789448210.015831:0:25068:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789448210.015844:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448210.015851:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448210.015853:0:25068:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789448210.015857:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448210.015861:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448210.015862:0:25068:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789448210.015866:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789448210.015868:0:25068:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789448210.015870:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448210.015872:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448210.015874:0:25068:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789448210.015876:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789448210.015878:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448210.015879:0:25068:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789448210.015883:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789448210.015922:0:25068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789448210.015926:0:25068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789448210.015928:0:25068:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789448210.015931:0:25068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789448210.016271:0:25064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789448210.016302:0:25064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789448210.016324:0:25064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47ba expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.016335:0:25064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517d90ee200/0x6522da1199ce47b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47ba expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448210.016343:0:25064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9516c7a84000 from 1 10000000:01000000:2.0:1789448210.016345:0:25064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789448210.016380:0:25064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.016388:0:25064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.016398:0:25064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448210.016435:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448210.016523:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.016571:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789448210.020566:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292416 00000100:00100000:3.0:1789448210.020588:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292416 00000100:00100000:3.0:1789448210.020667:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789448210.020676:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:25064:x1876371859292416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789448210.020692:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448210.020707:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce47cf expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448210.020744:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce47cf expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448210.020754:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce47cf expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448210.020763:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477bc00, rc 0) 00000100:00100000:3.0:1789448210.020831:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292416:12345-0@lo:101:mount.lustre.0 Request processed in 158us (4309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448210.020838:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789448210.021134:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448210.021152:0:25064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.021171:0:25064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448210.027077:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789448210.027373:0:25064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448210.028411:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789448210.028742:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789448210.028762:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789448210.028775:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789448210.028788:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789448210.028801:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789448210.028815:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789448210.028828:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789448210.028841:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789448210.028875:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1789448210.028891:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1789448210.029760:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1789448210.029768:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1789448210.029863:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448210.029947:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.029983:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448210.030227:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292544 00000100:00100000:3.0:1789448210.030235:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292544 00000100:00100000:3.0:1789448210.030287:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789448210.030296:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789448210.030423:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292544:12345-0@lo:501:mount.lustre.0 Request processed in 128us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448210.030430:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789448210.033255:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448210.033312:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448210.033381:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.033420:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448210.033520:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292672 00000100:00100000:0.0:1789448210.033527:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292672 00000100:00100000:0.0:1789448210.033584:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789448210.033593:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789448210.033712:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292672:12345-0@lo:503:mount.lustre.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.033720:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789448210.034587:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292672:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789448210.034992:0:25064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448210.035071:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448210.035120:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.035161:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517c29ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448210.035284:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292800 00000100:00100000:3.0:1789448210.035290:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292800 00000100:00100000:3.0:1789448210.035334:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789448210.035343:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448210.035480:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292800:12345-0@lo:502:mount.lustre.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448210.035489:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789448210.035773:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448210.035945:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789448210.035972:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789448210.035987:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789448210.036001:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789448210.036014:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789448210.036026:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789448210.036039:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789448210.036052:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789448210.036063:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789448210.036073:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789448210.036084:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789448210.036115:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448210.036149:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.036172:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517c29ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789448210.036886:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859292928 00000100:00100000:3.0:1789448210.036902:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859292928 00000100:00100000:3.0:1789448210.036953:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789448210.036960:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789448210.037061:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859292928:12345-0@lo:502:mount.lustre.0 Request processed in 101us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448210.037067:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789448210.037853:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859292928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448210.037939:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789448210.037951:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00010000:00010000:0.0:1789448210.038403:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789448210.046807:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448210.046819:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046821:0:25072:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789448210.046829:0:25072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9516c7a84000 00000020:00000080:3.0:1789448210.046832:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789448210.046839:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448210.046841:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046843:0:25072:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789448210.046845:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448210.046848:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046849:0:25072:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789448210.046852:0:25072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9516c7a84000 00000020:00000080:3.0:1789448210.046854:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789448210.046925:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448210.046929:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046931:0:25072:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789448210.046933:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448210.046935:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046937:0:25072:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789448210.046940:0:25072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9516c7a84000 00000020:00000080:3.0:1789448210.046942:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789448210.046959:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448210.046961:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046962:0:25072:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789448210.046965:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789448210.046967:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.046969:0:25072:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789448210.046986:0:25072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9516c7a84000 00000020:00000080:3.0:1789448210.046988:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789448210.047011:0:25072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789448210.047015:0:25072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789448210.047016:0:25072:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789448210.047019:0:25072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789448210.056754:0:25064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789448210.056802:0:25064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448210.056831:0:25064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.056844:0:25064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448210.057135:0:25064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789448210.057139:0:25064:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9516c7a84000 10000000:01000000:2.0:1789448210.057141:0:25064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9516c7a84000 10000000:01000000:2.0:1789448210.057145:0:25064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789448210.057150:0:25064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9516c7a84000 from 1 10000000:01000000:2.0:1789448210.057152:0:25064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789448210.057187:0:25064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.057195:0:25064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.057205:0:25064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448210.057227:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789448210.057291:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.057335:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293056 00000100:00100000:2.0:1789448210.057341:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293056 00000100:00100000:2.0:1789448210.057380:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789448210.057388:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859293056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448210.057400:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448210.057412:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c7b8d200/0x6522da1199ce47e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce47dd expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.059637:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8d200/0x6522da1199ce47e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce47dd expref: 24 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.059737:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c7b8d200/0x6522da1199ce47e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce47dd expref: 24 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.059746:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b8d200, rc 0) 00000100:00100000:2.0:1789448210.059809:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293056:12345-0@lo:101:mount.lustre.0 Request processed in 2421us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448210.059818:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789448210.059888:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80ecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789448210.061022:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789448210.061043:0:25064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47e4 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.061054:0:25064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce47e4 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448210.071342:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789448210.071630:0:25064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789448210.071780:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789448210.071801:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789448210.071811:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789448210.071822:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789448210.071832:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789448210.071842:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789448210.071852:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789448210.071863:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789448210.071887:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789448210.071909:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789448210.071921:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789448210.071940:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789448210.071950:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789448210.071960:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789448210.071973:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789448210.071985:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789448210.071995:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789448210.072006:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789448210.072016:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789448210.072026:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789448210.072037:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789448210.072047:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789448210.072057:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789448210.072071:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789448210.072098:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789448210.072113:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789448210.072125:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789448210.072136:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789448210.072147:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789448210.072158:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789448210.072168:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789448210.072181:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789448210.072194:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789448210.072205:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789448210.072217:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789448210.072230:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789448210.072242:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789448210.072254:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789448210.072264:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789448210.072274:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789448210.072296:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789448210.072307:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789448210.072317:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789448210.072329:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789448210.072349:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789448210.072362:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789448210.072373:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789448210.072385:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789448210.072521:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789448210.072542:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789448210.072561:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789448210.072566:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789448210.072652:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448210.072706:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.072741:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efe9d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448210.072952:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293184 00000100:00100000:0.0:1789448210.072959:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293184 00000100:00100000:0.0:1789448210.073003:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789448210.073011:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789448210.073107:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293184:12345-0@lo:501:mount.lustre.0 Request processed in 97us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.073115:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789448210.074015:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789448210.074056:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448210.074106:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.074134:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293312 00000100:00100000:2.0:1789448210.074139:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293312 00000100:00100000:2.0:1789448210.074173:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789448210.074180:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789448210.074263:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293312:12345-0@lo:503:mount.lustre.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448210.074271:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789448210.074315:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517efe9d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789448210.074327:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789448210.078118:0:25064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789448210.078210:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448210.078286:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.078337:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293440 00000100:00100000:2.0:1789448210.078343:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293440 00000100:00100000:2.0:1789448210.078382:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789448210.078391:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448210.078516:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293440:12345-0@lo:502:mount.lustre.0 Request processed in 126us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448210.078524:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789448210.078587:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448210.084786:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448210.085060:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789448210.085090:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789448210.085105:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789448210.085117:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789448210.085129:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789448210.085143:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789448210.085157:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789448210.085170:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789448210.085182:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789448210.085193:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789448210.085204:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789448210.085217:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789448210.085229:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789448210.085243:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789448210.085255:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789448210.085267:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789448210.085280:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789448210.085294:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789448210.085326:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789448210.085341:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789448210.085353:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789448210.085379:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789448210.085394:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789448210.085408:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789448210.085418:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789448210.085429:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789448210.085440:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789448210.085453:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789448210.085493:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789448210.085508:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789448210.085522:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789448210.085537:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789448210.085551:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789448210.085565:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789448210.085605:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789448210.085621:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789448210.085634:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789448210.085647:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789448210.085671:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789448210.085686:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789448210.085699:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789448210.085710:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789448210.085721:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789448210.085732:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789448210.085743:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789448210.085755:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789448210.085766:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789448210.085778:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789448210.085822:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448210.085888:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.085932:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448210.088367:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293568 00000100:00100000:0.0:1789448210.088393:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293568 00000100:00100000:0.0:1789448210.088439:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789448210.088447:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448210.088723:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293568:12345-0@lo:502:mount.lustre.0 Request processed in 275us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.088730:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789448210.088801:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789448210.089940:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789448210.089995:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789448210.090035:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789448210.090097:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.090143:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f80ecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448210.090318:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293696 00000100:00100000:0.0:1789448210.090326:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293696 00000100:00100000:0.0:1789448210.090363:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789448210.090370:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789448210.090512:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859293696:12345-0@lo:502:mount.lustre.0 Request processed in 142us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.090525:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789448210.090626:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859293696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789448210.093524:0:25064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789448210.093552:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789448210.095219:0:25077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789448210.095235:0:25077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9517f9390000) 00000020:00000080:1.0:1789448210.095258:0:25077:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789448210.095375:0:25077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9516c7a84000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789448210.095380:0:25077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9516c7a84000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789448210.095382:0:25077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9516c7a84000 3 00010000:00080000:1.0:1789448210.095410:0:25077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9516c7a09000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.138@tcp at head 00010000:00010000:1.0:1789448210.097171:0:25077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789448210.097402:0:25077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789448210.097447:0:25077:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789448210.097487:0:25077:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6522da1199ce47f2 00000100:00080000:1.0:1789448210.097496:0:25077:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789448210.097506:0:25077:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9516c7a09000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448210.097675:0:25077:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e0380 x1876371859293824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448210.097694:0:25077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789448210.097767:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3631:1876371859293824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448210.097831:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.097884:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293824 00000100:00100000:0.0:1789448210.097892:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293824 00000100:00100000:0.0:1789448210.097925:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448210.097932:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3631:x1876371859293824:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789448210.097954:0:22744:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:0.0:1789448210.097990:0:22744:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6522da1199ce47f9 00000004:00100000:0.0:1789448210.098003:0:22744:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789448210.098029:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9517ebf30000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448210.099275:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1876371859293824:12345-0@lo:38:llog_process_th.0 Request processed in 1336us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.099286:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448210.099319:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1789448210.099528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448210.099533:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448210.099536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448210.099539:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789448210.099720:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859294080:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.099777:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.099804:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859293952:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.099827:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.099861:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859293952 00000100:00100000:0.0:1789448210.099868:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859293952 00000100:00100000:0.0:1789448210.099902:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789448210.099909:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859293952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.099967:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859293952:12345-0@lo:400:kworker.0 Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.099973:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789448210.100117:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517fb9e0380 x1876371859293824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448210.100138:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789448210.100147:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789448210.100153:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789448210.100158:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789448210.100160:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c7a09000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789448210.100167:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3631:1876371859293824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789448210.100195:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859293952:0@lo:400:kworker.0 00000100:00100000:1.0:1789448210.100729:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294080 00000100:00100000:1.0:1789448210.100736:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294080 00000100:00100000:1.0:1789448210.100859:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789448210.100867:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859294080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448210.100920:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1876371859294080:12345-0@lo:400:kworker.0 Request processed in 55us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448210.100933:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789448210.101353:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c83ad500 x1876371859294080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448210.101362:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3633:1876371859294080:0@lo:400:kworker.0 00000100:00080000:2.0:1789448210.104825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448210.104830:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789448210.104833:0:8:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789448210.104841:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 608 00000100:00080000:2.0:1789448210.104847:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789448210.104856:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9517fd6fd000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:0.0:1789448210.104872:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859294208:0@lo:400:kworker.0 00000100:00100000:2.0:1789448210.104877:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c83aca80 x1876371859294464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789448210.104936:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859294592:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.104937:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.104977:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859294848:0@lo:400:kworker.0 00000100:00100000:2.0:1789448210.104980:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.105008:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448210.105010:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789448210.105019:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859294720:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.105028:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789448210.105130:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859294336:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.105150:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.105175:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294208 00000100:00100000:0.0:1789448210.105182:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294208 00000100:00100000:0.0:1789448210.105213:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448210.105220:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859294208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.105272:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859294208:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.105286:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448210.105312:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294336 00000100:00100000:0.0:1789448210.105316:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294336 00000100:00100000:0.0:1789448210.105348:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789448210.105354:0:24250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859294336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.105397:0:24250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859294336:12345-0@lo:400:kworker.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.105403:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789448210.105417:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448210.105428:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294592 00000100:00100000:0.0:1789448210.105432:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294592 00000100:00100000:0.0:1789448210.105453:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294848 00000100:00100000:0.0:1789448210.105456:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294848 00000100:00100000:0.0:1789448210.105508:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789448210.105515:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859294592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.105544:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1876371859294592:12345-0@lo:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.105550:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789448210.105561:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789448210.105589:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859294848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.105623:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859294848:12345-0@lo:400:kworker.0 Request processed in 55us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.105629:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789448210.105647:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789448210.105664:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859294464:0@lo:8:kworker.0 00000100:00100000:0.0:1789448210.105687:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448210.105724:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294464 00000100:00100000:0.0:1789448210.105728:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294464 00000100:00100000:0.0:1789448210.105745:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789448210.105750:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3631:x1876371859294464:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789448210.105792:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3631:x1876371859294464:12345-0@lo:8:kworker.0 Request processed in 41us (104us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789448210.105798:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448210.105874:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789448210.105905:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c83ad500 x1876371859294592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448210.105917:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3632:1876371859294592:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.106089:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294720 00000100:00100000:0.0:1789448210.106094:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294720 00000100:00100000:0.0:1789448210.106133:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448210.106139:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859294720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.106171:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859294720:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448210.106177:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789448210.106202:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c83af800 x1876371859294720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448210.106211:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859294720:0@lo:400:kworker.0 00010000:00080000:0.0:1789448210.106231:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c83ac380 x1876371859294336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448210.106240:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859294336:0@lo:400:kworker.0 00010000:00080000:0.0:1789448210.106248:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c83adc00 x1876371859294848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448210.106255:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859294848:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.106264:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859294208:0@lo:400:kworker.0 00000100:00100000:0.0:1789448210.106284:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789448210.106295:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789448210.106299:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789448210.106302:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859294464:0@lo:8:kworker.0 00000100:00080000:2.0:1789448210.106327:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1789448210.106788:0:25077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789448210.106802:0:25077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9517f80fb380) 00000020:00000080:1.0:1789448210.106821:0:25077:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789448210.106914:0:25077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9516c7a84000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789448210.106919:0:25077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9516c7a84000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789448210.106926:0:25077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9516c7a84000 3 00010000:00080000:1.0:1789448210.106961:0:25077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9516c5be4800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.138@tcp at head 00010000:00010000:1.0:1789448210.108528:0:25077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789448210.108696:0:25077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789448210.108730:0:25077:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789448210.108740:0:25077:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6522da1199ce4807 00000100:00080000:1.0:1789448210.108748:0:25077:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789448210.108755:0:25077:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9516c5be4800 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:1.0:1789448210.108782:0:25077:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9517fb9e0000 x1876371859294976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789448210.108811:0:25077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789448210.108897:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3631:1876371859294976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789448210.108951:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789448210.111420:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448210.111429:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789448210.111431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789448210.111434:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789448210.113359:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859294976 00000100:00100000:1.0:1789448210.113372:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859294976 00000100:00100000:1.0:1789448210.113500:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789448210.113508:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3631:x1876371859294976:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789448210.113538:0:22745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1789448210.113573:0:22745:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6522da1199ce480e 00000004:00100000:1.0:1789448210.113602:0:22745:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789448210.113632:0:22745:0:(import.c:65:import_set_state_nolock()) ffff9516c5be3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448210.113727:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1876371859294976:12345-0@lo:38:llog_process_th.0 Request processed in 218us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448210.113736:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789448210.113778:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517fb9e0000 x1876371859294976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789448220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448210.113790:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789448210.113798:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789448210.113805:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789448210.113810:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789448210.113813:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9516c5be4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789448210.113820:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3631:1876371859294976:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789448210.114960:0:25077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789448210.115040:0:25064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789448210.115071:0:25064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789448210.115086:0:25064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47e4 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448210.115097:0:25064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8c200/0x6522da1199ce47dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce47e4 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789448210.115147:0:25064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789448210.115150:0:25064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789448210.115151:0:25064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448210.115156:0:25064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448210.115157:0:25064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448210.115158:0:25064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448210.115160:0:25064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789448210.115161:0:25064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448210.115162:0:25064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789448210.115167:0:25064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789448210.115169:0:25064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789448210.115170:0:25064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789448210.115171:0:25064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789448210.115172:0:25064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789448210.115173:0:25064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789448210.115174:0:25064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789448210.115175:0:25064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789448210.115175:0:25064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789448210.115176:0:25064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789448210.115198:0:25064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789448210.115216:0:25064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859295104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789448210.115273:0:25064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448210.115765:0:25064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517c11c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789448210.115765:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295104 00000100:00100000:0.0:1789448210.115773:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295104 00000100:00100000:0.0:1789448210.115826:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789448210.115834:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:25064:x1876371859295104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789448210.115857:0:22739:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789448210.115871:0:22739:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789448210.126537:0:22739:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789448210.126555:0:22739:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789448210.127254:0:22760:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789448210.127261:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789448210.127281:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.127298:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.127316:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4790 expref: 24 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.127323:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.127356:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4790 expref: 24 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.127369:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4790 expref: 24 pid: 22739 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448210.127383:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859295232:0@lo:104: 00000100:00100000:1.0:1789448210.127435:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448210.127501:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.127508:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448210.127517:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859295360:0@lo:104: 00000100:00100000:1.0:1789448210.127558:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448210.127571:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517c12549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448210.128601:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295232 00000100:00100000:2.0:1789448210.128611:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295232 00000100:00100000:2.0:1789448210.128646:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295360 00000100:00100000:2.0:1789448210.128648:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295360 00000100:00100000:2.0:1789448210.128660:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448210.128668:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:22760:x1876371859295232:12345-0@lo:104: 00010000:00010000:2.0:1789448210.128681:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129030:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789448210.129115:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:22760:x1876371859295232:12345-0@lo:104: Request processed in 370us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448210.129124:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448210.129140:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448210.129157:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859295360:12345-0@lo:104: 00010000:00010000:2.0:1789448210.129165:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129200:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789448210.129205:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:22760:x1876371859295360:12345-0@lo:104: Request processed in 49us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448210.129210:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789448210.129229:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448210.129234:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129241:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8d400 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:2.0:1789448210.129245:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129253:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448210.129259:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448210.129264:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448210.129292:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129299:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448210.129315:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129331:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d400/0x6522da1199ce4790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce4797 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129344:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448210.129347:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129352:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e400 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:2.0:1789448210.129355:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129361:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789448210.129367:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448210.129372:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789448210.129383:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129389:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789448210.129401:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129408:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517fd75e400/0x6522da1199ce4782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce4789 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.129419:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448210.129426:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448210.129428:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448210.129433:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448210.129477:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859295488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448210.129509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448210.129981:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859295232:0@lo:104: 00000100:00100000:1.0:1789448210.129991:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22760:1876371859295360:0@lo:104: 00010000:00010000:1.0:1789448210.130010:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448210.130104:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295488 00000100:00100000:2.0:1789448210.130110:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295488 00010000:00010000:2.0:1789448210.130131:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4790 expref: 25 pid: 22739 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448210.130164:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448210.130172:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+25:3635:x1876371859295488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789448210.130183:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448210.130188:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4790 expref: 25 pid: 22739 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.131157:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4790 expref: 25 pid: 22739 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.131176:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517fd75fe00/0x6522da1199ce4797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4790 expref: 25 pid: 22739 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448210.131189:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448210.131374:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3635:x1876371859295488:12345-0@lo:103:ldlm_bl.0 Request processed in 1202us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448210.131382:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789448210.131512:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859295488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448210.131582:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859295616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789448210.131615:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448210.131697:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295616 00000100:00100000:1.0:1789448210.131705:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295616 00010000:00010000:1.0:1789448210.131857:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448210.131923:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789448210.131933:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3632:x1876371859295616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448210.131946:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448210.131951:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.131961:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.131972:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8c800/0x6522da1199ce4789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4782 expref: 24 pid: 22740 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.131985:0:22731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.131993:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789448210.132008:0:22731:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014366852s 00010000:00010000:1.0:1789448210.132013:0:22731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132020:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132036:0:22731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132043:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132050:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d90ef000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448210.132054:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132063:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448210.132076:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:25064:x1876371859295104:12345-0@lo:253:mount.lustre.0 Request processed in 16240us (16801us total) trans 0 rc 0/0 00010000:00010000:1.0:1789448210.132080:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448210.132089:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1789448210.132093:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448210.132129:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:3632:x1876371859295616:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448210.132136:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448210.132188:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859295616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448210.132366:0:22760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132374:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448210.132379:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d90ef000/0x6522da1199ce4815 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448210.132695:0:25064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:562d8d7b-adf5-44cc-8730-f8665ac1447a:25064:1876371859295104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789448210.132706:0:25064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789448210.132709:0:25064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789448210.132711:0:25064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789448210.132712:0:25064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789448210.132713:0:25064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789448210.132715:0:25064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789448210.132716:0:25064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789448210.132718:0:25064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789448210.132719:0:25064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789448210.132720:0:25064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789448210.132741:0:25064:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1789448210.155792:0:25064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789448210.160488:0:25064:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789448210.160497:0:25064:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789448210.160529:0:25064:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789448210.160572:0:25064:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789448210.160601:0:25064:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789448210.160624:0:25064:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789448210.161422:0:25064:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448210.161692:0:25064:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1789448210.431070:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789448211.061611:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789448211.271425:0:25131:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789448211.271720:0:25131:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789448211.637854:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859295744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789448211.637924:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448211.638034:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295744 00000100:00100000:3.0:1789448211.638042:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295744 00000100:00100000:3.0:1789448211.638093:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789448211.638101:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859295744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789448211.638125:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789448211.638647:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859295744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 545us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448211.638655:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789448211.638711:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c796a300 x1876371859295744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448211.638793:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859295744:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1789448211.893617:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789448211.893623:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517d3af2000 from 14 10000000:01000000:2.0:1789448211.893628:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789448211.893668:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.893679:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.893691:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448211.893727:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859295872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448211.893790:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448211.893842:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789448211.893975:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859295872 00000100:00100000:3.0:1789448211.893982:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859295872 00000100:00100000:3.0:1789448211.894168:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789448211.894178:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859295872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448211.894191:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448211.894210:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d477a400/0x6522da1199ce4823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce481c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448211.894231:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d477a400/0x6522da1199ce4823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce481c expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448211.894241:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d477a400/0x6522da1199ce4823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce481c expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448211.894248:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d477a400, rc 0) 00000100:00100000:3.0:1789448211.894296:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859295872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448211.894303:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789448211.894430:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859295872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448211.894444:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4823 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.894453:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4823 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448211.894526:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859296000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789448211.894555:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448211.894760:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789448211.894876:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296000 00000100:00100000:1.0:1789448211.894881:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296000 00000100:00100000:1.0:1789448211.894916:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789448211.894922:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859296000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789448211.894935:0:22740:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789448211.894952:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789448211.894955:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789448211.895035:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859296000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448211.895041:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789448211.895248:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859296000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789448211.895301:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448211.895307:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4823 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895315:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8ce00/0x6522da1199ce481c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4823 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789448211.895324:0:22742:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789448211.895326:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9517fb910000 from 14 10000000:01000000:2.0:1789448211.895329:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789448211.895348:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895364:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895372:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448211.895386:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859296128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789448211.895423:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448211.895441:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789448211.895454:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296128 00000100:00100000:2.0:1789448211.895457:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296128 00000100:00100000:2.0:1789448211.895518:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789448211.895523:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859296128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448211.895531:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448211.895539:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce4831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce482a expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895555:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce4831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce482a expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895563:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c7b8de00/0x6522da1199ce4831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce482a expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895581:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b8de00, rc 0) 00000100:00100000:2.0:1789448211.895609:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859296128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448211.895615:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789448211.895648:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859296128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448211.895658:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4831 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.895666:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4831 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448211.895702:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859296256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789448211.895731:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448211.895749:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789448211.895760:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296256 00000100:00100000:2.0:1789448211.895763:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296256 00000100:00100000:2.0:1789448211.895778:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789448211.895783:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859296256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789448211.895792:0:22740:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789448211.895802:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789448211.895805:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789448211.895863:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859296256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448211.895869:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789448211.896027:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859296256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789448211.896063:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789448211.896068:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4831 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448211.896076:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c7b8dc00/0x6522da1199ce482a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4831 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448212.085772:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448212.663354:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448212.663376:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859296384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789448212.663441:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448212.665878:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296384 00000100:00100000:1.0:1789448212.665897:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296384 00000100:00100000:1.0:1789448212.665949:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789448212.665958:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859296384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789448212.665994:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789448212.666067:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859296384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448212.666074:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789448212.666194:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859296384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789448212.667231:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789448212.667248:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859296512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789448212.667296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448212.667531:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296512 00000100:00100000:0.0:1789448212.667539:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296512 00000100:00100000:0.0:1789448212.667587:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448212.667596:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859296512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789448212.667633:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448212.667690:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859296512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448212.667697:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789448212.667816:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859296512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789448213.112116:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448213.174024:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448193/real 1789448193] req@ffff9517fb9e1500 x1876371859282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448213 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448213.174055:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517fb9e1500 x1876371859282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448213 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448213.174065:0:3631:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789448193/real 1789448193] req@ffff9517fb9e3800 x1876371859282432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448213 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448213.174077:0:3631:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9517fb9e3800 x1876371859282432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789448213 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789448213.174095:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448213.174122:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789448213.174126:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859282304:0@lo:8:kworker.0 00000100:00080000:2.0:1789448213.174132:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789448213.174137:0:3631:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789448213.174140:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859282432:0@lo:8:kworker.0 00000100:00100000:0.0:1789448213.174682:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859296640:0@lo:400:kworker.0 00000100:00100000:0.0:1789448213.174737:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.177652:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859296768:0@lo:400:kworker.0 00000100:00100000:2.0:1789448213.177721:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.177791:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296640 00000100:00100000:2.0:1789448213.177798:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296640 00000100:00100000:2.0:1789448213.177843:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789448213.177851:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3632:x1876371859296640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448213.184534:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296768 00000100:00100000:1.0:1789448213.184549:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296768 00000100:00100000:1.0:1789448213.184627:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789448213.184638:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859296768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448213.184729:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859296768:12345-0@lo:400:kworker.0 Request processed in 93us (7007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448213.184736:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789448213.184792:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859296768:0@lo:400:kworker.0 00000100:00080000:3.0:1789448213.188519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448213.188528:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789448213.188532:0:38:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448213.188539:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:3.0:1789448213.188544:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789448213.188556:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9517f77a0000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448213.188620:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f2d80 x1876371859296896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789448213.188660:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448213.188664:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789448213.188665:0:38:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448213.188669:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:3.0:1789448213.188672:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789448213.188678:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9517fda0d000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448213.188691:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c82f0e00 x1876371859297024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448213.188727:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859297152:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.188784:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.188850:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859297280:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.188877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.188912:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297280 00000100:00100000:3.0:1789448213.188918:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297280 00000100:00100000:3.0:1789448213.188955:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789448213.188963:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859297280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189006:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859297280:12345-0@lo:400:kworker.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.189012:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789448213.189044:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859297280:0@lo:400:kworker.0 00000100:00080000:3.0:1789448213.189072:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789448213.189076:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789448213.189078:0:38:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789448213.189083:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9517fd6fd000 using connection 192.168.206.138@tcp/0@lo 00000100:00100000:3.0:1789448213.189094:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448213.189102:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859297408:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189131:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.189158:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9516c770ed80 x1876371859297536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789448213.189178:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859297664:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189196:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.189230:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859297792:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189248:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.189270:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297152 00000100:00100000:3.0:1789448213.189274:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297152 00000100:00100000:3.0:1789448213.189294:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297664 00000100:00100000:3.0:1789448213.189296:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297664 00000100:00100000:3.0:1789448213.189306:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297792 00000100:00100000:3.0:1789448213.189308:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297792 00000100:00100000:3.0:1789448213.189332:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448213.189339:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189372:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859297152:12345-0@lo:400:kworker.0 Request processed in 34us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.189378:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789448213.189390:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448213.189396:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189424:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859297664:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.189430:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789448213.189443:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789448213.189450:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189506:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859297792:12345-0@lo:400:kworker.0 Request processed in 56us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.189512:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789448213.189527:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789448213.189543:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7053b80 x1876371859297792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.189552:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859297792:0@lo:400:kworker.0 00010000:00080000:3.0:1789448213.189575:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c770dc00 x1876371859297152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.189582:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859297152:0@lo:400:kworker.0 00010000:00080000:3.0:1789448213.189609:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c770d180 x1876371859297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.189617:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859297664:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189647:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3635:1876371859297920:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189670:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.189693:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297920 00000100:00100000:3.0:1789448213.189696:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297920 00000100:00100000:3.0:1789448213.189722:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789448213.189728:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876371859297920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189758:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876371859297920:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.189764:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789448213.189775:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789448213.189788:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7053b80 x1876371859297920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.189802:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3635:1876371859297920:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189832:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448213.189838:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859298048:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189863:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.189884:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298048 00000100:00100000:3.0:1789448213.189887:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298048 00000100:00100000:3.0:1789448213.189911:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789448213.189934:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1876371859298048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.189967:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1876371859298048:12345-0@lo:400:kworker.0 Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.189974:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789448213.189987:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789448213.190001:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7053b80 x1876371859298048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.190010:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859298048:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.190042:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859298176:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.190064:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.190086:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298176 00000100:00100000:3.0:1789448213.190090:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298176 00000100:00100000:3.0:1789448213.190111:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789448213.190117:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859298176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.190146:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859298176:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.190152:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789448213.190174:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789448213.190191:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7053b80 x1876371859298176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.190200:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859298176:0@lo:400:kworker.0 00000100:00100000:3.0:1789448213.190304:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859296896:0@lo:8:kworker.0 00000100:00100000:3.0:1789448213.190334:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.190362:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859297024:0@lo:8:kworker.0 00000100:00100000:3.0:1789448213.190385:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.190401:0:3631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859297536:0@lo:8:kworker.0 00000100:00100000:3.0:1789448213.190422:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.192823:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3632:x1876371859296640:12345-0@lo:400:kworker.0 Request processed in 14965us (18077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.192851:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789448213.192943:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297408 00000100:00100000:2.0:1789448213.192951:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297408 00000100:00100000:2.0:1789448213.192987:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859296896 00000100:00100000:2.0:1789448213.192990:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859296896 00000100:00100000:2.0:1789448213.192999:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297024 00000100:00100000:2.0:1789448213.193001:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297024 00000100:00100000:2.0:1789448213.193007:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859297536 00000100:00100000:2.0:1789448213.193009:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859297536 00000100:00100000:2.0:1789448213.193019:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448213.193026:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859297408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448213.193086:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859297408:12345-0@lo:400:kworker.0 Request processed in 61us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.193091:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789448213.193101:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448213.193105:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3631:x1876371859296896:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789448213.193128:0:24251:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1789448213.193151:0:24251:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce4838 00002000:00100000:2.0:1789448213.193162:0:24251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9516c783e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789448213.193166:0:24251:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789448213.193169:0:24251:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789448213.193230:0:24251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789448213.193250:0:24251:0:(import.c:65:import_set_state_nolock()) ffff9516c783d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448213.193283:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3631:x1876371859296896:12345-0@lo:8:kworker.0 Request processed in 176us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.193289:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448213.193300:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448213.193309:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3631:x1876371859297024:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789448213.193324:0:24251:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1789448213.193337:0:24251:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6522da1199ce483f 00002000:00100000:2.0:1789448213.193342:0:24251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9516c783c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789448213.193345:0:24251:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789448213.193347:0:24251:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789448213.193504:0:24251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789448213.193518:0:24251:0:(import.c:65:import_set_state_nolock()) ffff9516c783f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448213.193547:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3631:x1876371859297024:12345-0@lo:8:kworker.0 Request processed in 237us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.193554:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448213.193579:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448213.193583:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3631:x1876371859297536:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789448213.193598:0:24251:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1789448213.193612:0:24251:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6522da1199ce4846 00002000:00100000:2.0:1789448213.193617:0:24251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9516c783e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789448213.193620:0:24251:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789448213.193622:0:24251:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789448213.193639:0:24251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789448213.193650:0:24251:0:(import.c:65:import_set_state_nolock()) ffff9516c783d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448213.193677:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3631:x1876371859297536:12345-0@lo:8:kworker.0 Request processed in 93us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.193684:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789448213.197617:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789448213.197666:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c770c000 x1876371859297408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.197681:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859297408:0@lo:400:kworker.0 00010000:00080000:3.0:1789448213.197723:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c82f2d80 x1876371859296896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.197731:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789448213.197739:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789448213.197747:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789448213.197752:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789448213.197755:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517f77a0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789448213.200054:0:3631:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789448213.200067:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859296896:0@lo:8:kworker.0 00010000:00080000:3.0:1789448213.200099:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c82f0e00 x1876371859297024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.200124:0:3631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789448213.200132:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789448213.200141:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789448213.200146:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789448213.200149:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fda0d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789448213.200165:0:3631:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789448213.200169:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3631:1876371859297024:0@lo:8:kworker.0 00010000:00080000:3.0:1789448213.200183:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c770ed80 x1876371859297536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789448238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789448213.200193:0:3631:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789448213.200197:0:3631:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789448213.200199:0:3631:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789448213.200201:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9517fd6fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789448213.200210:0:3631:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789448213.200212:0:3631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3631:1876371859297536:0@lo:8:kworker.0 00000004:00080000:3.0:1789448213.200270:0:22771:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1789448213.200287:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7050700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22771:1876371859298432:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789448213.200333:0:22771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.200354:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f8332480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448213.200367:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859298304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789448213.200389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448213.200422:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298432 00000100:00100000:3.0:1789448213.200428:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298432 00000100:00100000:3.0:1789448213.200491:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448213.200500:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22771:x1876371859298432:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789448213.202061:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859296640:0@lo:400:kworker.0 00000004:00080000:0.0:1789448213.202111:0:22768:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789448213.202193:0:22768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 615419732163ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789448213.202199:0:22768:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789448213.203400:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298304 00000100:00100000:3.0:1789448213.203409:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298304 00000100:00100000:3.0:1789448213.203448:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448213.203473:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3634:x1876371859298304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789448213.203500:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789448213.203582:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3634:x1876371859298304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.203589:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789448213.203616:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789448213.203661:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517e7053100 x1876371859298304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.203678:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859298304:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789448213.204736:0:22769:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789448213.204759:0:22769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22769:1876371859298688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789448213.204811:0:22769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.204836:0:22769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517caa27180 going to sleep for 11 seconds 00000004:00080000:2.0:1789448213.204870:0:23488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789448213.204884:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23488:1876371859298944:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789448213.204912:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.204924:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d308d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789448213.204938:0:24250:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789448213.204944:0:24250:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789448213.205055:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448213.205065:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859298560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448213.205093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.205118:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298560 00000100:00100000:2.0:1789448213.205123:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298560 00000100:00100000:2.0:1789448213.205162:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789448213.205170:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1876371859298560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448213.205191:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448213.205226:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1876371859298560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.205233:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789448213.205252:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789448213.205272:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c83af800 x1876371859298560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448213.205287:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859298560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789448213.205507:0:24249:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789448213.205517:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298688 00000100:00100000:3.0:1789448213.205520:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298688 00000100:00100000:0.0:1789448213.206782:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859298816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789448213.206827:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448213.206861:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298816 00000100:00100000:0.0:1789448213.206866:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298816 00000100:00100000:0.0:1789448213.206902:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448213.206909:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1876371859298816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789448213.206924:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789448213.206953:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1876371859298816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448213.206958:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789448213.206978:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789448213.206997:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7488e00 x1876371859298816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789448229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448213.207012:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859298816:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1789448213.208740:0:22770:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789448213.208831:0:22770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 615426369298ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789448213.208837:0:22770:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789448213.208854:0:23487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789448213.208906:0:23487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 615426444906ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789448213.208911:0:23487:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789448213.209312:0:22725:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789448213.209624:0:24251:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789448213.209632:0:24251:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1789448213.209638:0:24251:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:2.0:1789448213.218587:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859298944 00000100:00100000:2.0:1789448213.218600:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859298944 00000100:00100000:0.0:1789448213.218761:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789448213.218772:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23488:x1876371859298944:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789448213.235617:0:22725:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789448213.237603:0:25215:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789448213.237611:0:25215:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789448213.237709:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23488:x1876371859298944:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18936us (32792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448213.237720:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789448213.237750:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789448213.237761:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22769:x1876371859298688:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:2.0:1789448213.237852:0:23488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7489500 x1876371859298944/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789448229 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448213.237878:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23488:1876371859298944:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789448213.237890:0:23488:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789448213.237924:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23488:1876371859299072:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789448213.237958:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.237992:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d308d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789448213.238096:0:24250:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789448213.238104:0:24250:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789448213.240757:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299072 00000100:00100000:0.0:1789448213.240770:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299072 00000100:00100000:2.0:1789448213.241234:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789448213.241245:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23488:x1876371859299072:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789448213.241272:0:25219:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1789448213.241345:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23488:x1876371859299072:12345-0@lo:5:osp-pre-1-1.0 Request processed in 102us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448213.241351:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789448213.242773:0:23488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7489500 x1876371859299072/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789448229 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448213.242787:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23488:1876371859299072:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789448213.242800:0:23488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789448213.242839:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c796a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23488:1876371859299200:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789448213.242877:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448213.242908:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d308d840 going to sleep for 11 seconds 00000004:00080000:1.0:1789448213.246229:0:23476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789448213.248667:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299200 00000100:00100000:3.0:1789448213.248680:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299200 00000100:00100000:3.0:1789448213.248735:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789448213.248745:0:24250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23488:x1876371859299200:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789448213.248784:0:24250:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1789448213.250844:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.250855:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250870:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.250874:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.250886:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250912:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250922:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250929:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250947:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.250958:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.250963:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250970:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.250974:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250983:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.250998:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.251004:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce484d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.251027:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.251029:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.251031:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.253330:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.253343:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253357:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.253361:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.253367:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253380:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253390:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253397:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253414:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.253424:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.253429:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253451:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.253455:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253484:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253498:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253505:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce4854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.253522:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.253524:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.253525:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.254684:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.254692:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.254703:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.254707:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.254711:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.254721:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.254738:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.254745:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.254766:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448213.255549:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448213.255557:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.255578:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477ae00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:0.0:1789448213.255588:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.255598:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.255615:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.255623:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022fd9674/0x6522da1199ce485b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.255641:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.255643:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.255645:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.257921:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.257932:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.257948:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.257952:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.257958:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.257971:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.257981:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.257989:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.258023:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.258172:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.258179:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.258187:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d90efe00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.258192:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.258201:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.258215:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.258223:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a36f720b/0x6522da1199ce4862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.258241:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.258248:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.258249:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448213.260032:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.260045:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.260059:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.260063:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.260068:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.260081:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.260643:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.260658:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.260694:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.260810:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.260816:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.260824:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.260829:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.260837:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.260853:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.260860:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.260877:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.260878:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.260880:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448213.262805:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.262817:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262832:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.262836:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.262842:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262853:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262862:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262869:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262885:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448213.262895:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448213.262900:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262913:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:0.0:1789448213.262917:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262925:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262939:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.262945:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.263477:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.263479:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.263481:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789448213.264908:0:25215:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789448213.264918:0:25215:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1789448213.264924:0:25215:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:1.0:1789448213.268452:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.268481:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.268497:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.268501:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.268507:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.268520:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.268825:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.268836:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.268855:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789448213.279427:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.279439:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.279456:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.279487:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.279493:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.279507:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.279517:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.279525:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.279544:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789448213.280026:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.280033:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280041:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.280043:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.280048:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280061:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280078:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280085:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280099:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789448213.280109:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448213.280114:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280122:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d90ef400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.280126:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280135:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280153:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280160:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c34b9a79/0x6522da1199ce4877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280177:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.280187:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280193:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d90ef000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.280196:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280203:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280214:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280220:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb87845a/0x6522da1199ce487e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280232:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.280236:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280242:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8cc00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.280244:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280251:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280272:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280279:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071ad88a6/0x6522da1199ce4885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.280291:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.280293:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.280295:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.280983:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.280991:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281000:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.281003:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.281008:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281017:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281026:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281039:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281054:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.281194:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.281200:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.281208:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.281211:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.281220:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.281232:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.281240:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000736f5caa/0x6522da1199ce488c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.281266:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.281268:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.281270:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.281307:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.281313:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789448213.281570:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.281576:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281584:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.281587:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.281591:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281599:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281606:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281613:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281627:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448213.281633:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448213.281647:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281660:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031e00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.281663:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281671:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281682:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281689:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001736eaf1/0x6522da1199ce489a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.281702:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.281704:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.281705:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.282122:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.282128:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282136:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.282139:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.282143:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282152:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282165:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282172:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282183:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448213.282189:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448213.282192:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282198:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.282201:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282208:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282218:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282225:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5a6d35/0x6522da1199ce48a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282237:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.282242:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.282244:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.282444:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.282447:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.282452:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282483:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282492:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282499:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282515:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448213.282740:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448213.282745:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282753:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8c600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.282756:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282765:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282778:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282785:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089868dba/0x6522da1199ce4893 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.282801:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.282803:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.282804:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.282885:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.282891:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282909:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.282912:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.282917:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282926:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282935:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282941:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.282989:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789448213.283102:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.283108:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283115:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.283118:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.283122:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283131:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283149:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283157:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283449:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448213.283454:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283479:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8da00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.283483:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283497:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283508:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283515:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722401d1/0x6522da1199ce48a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283530:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448213.283534:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283541:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8c800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.283544:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283551:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283571:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.283579:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.283581:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.283590:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.283744:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789448213.283749:0:25215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae4a7c73/0x6522da1199ce48af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448213.283809:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.283815:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283823:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.283826:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.283831:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283839:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283847:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283862:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.283870:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.284109:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.284116:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.284123:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8d400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.284127:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.284141:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.284153:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.284160:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d4a6aa9/0x6522da1199ce48b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.284174:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.284176:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.284178:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.284184:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.284209:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.284385:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.284390:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284398:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.284401:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.284404:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284413:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284421:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284429:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284447:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789448213.284836:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.284842:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284856:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.284859:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.284864:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284874:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284882:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284904:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.284994:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789448213.285369:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.285375:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285383:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.285386:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.285389:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285398:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285416:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285424:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285439:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789448213.285447:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448213.285450:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285457:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.285485:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285493:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285505:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285513:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eecbb98/0x6522da1199ce48bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285527:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.285536:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285543:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.285546:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285554:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285575:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285582:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce48c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285594:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.285596:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285602:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.285605:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285612:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285634:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285653:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce48cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.285666:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.285668:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.285670:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.286661:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.286796:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.286937:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.286944:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.286954:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.286958:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.286962:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.286971:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.286979:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.286985:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287004:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.287017:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.287023:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287030:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.287033:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287041:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287052:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287058:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce48d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287070:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.287072:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.287074:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.287382:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.287389:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.287397:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.287400:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.287404:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.287414:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.287434:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.287441:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.287479:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.287626:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.287631:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287710:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.287720:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287727:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287739:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287746:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f213f32b/0x6522da1199ce48d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.287759:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.287761:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.287763:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.289976:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.289988:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290003:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.290007:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.290012:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290024:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290033:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290047:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290062:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.290305:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.290312:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.290439:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.290443:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.290452:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.290492:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.290500:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e948c4/0x6522da1199ce48e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.290518:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.290525:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.290526:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.290840:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.290846:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290855:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.290858:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.290862:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290871:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290879:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290886:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290900:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.290908:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.290912:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290927:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.290930:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290939:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290950:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290957:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce48e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.290969:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.290971:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.290972:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.291165:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.291172:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291180:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.291183:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.291188:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291197:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291205:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291212:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291277:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448213.291525:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.291531:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291540:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.291543:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.291547:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291572:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291581:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.291589:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292439:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.292447:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292456:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.292476:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292485:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292505:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292512:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b38a493b/0x6522da1199ce48ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292528:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.292532:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292539:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.292542:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292550:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292568:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.292576:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.292578:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.292580:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.294517:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448213.294527:0:24251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce48f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448213.294694:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.294702:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.294715:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.294719:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.294725:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.294740:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.294755:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.294763:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448213.298614:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.298627:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.298718:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.298723:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.298729:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.298743:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.298752:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.298760:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299864:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789448213.299874:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299885:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.299890:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299899:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299915:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299924:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448213.299928:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299935:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.299938:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299945:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299954:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.299973:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.299975:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.299976:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.300509:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.300694:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789448213.300702:0:25215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0ee04c4/0x6522da1199ce48fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.303032:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789448213.303045:0:24251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f45112ab/0x6522da1199ce4903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.303298:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.303865:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.303872:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.303886:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.303904:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.303911:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.303937:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.303948:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.303956:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.303978:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789448213.304585:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789448213.304592:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.304610:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448213.304615:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.304624:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.304835:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.304844:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab5d1119/0x6522da1199ce490a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.304859:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.304861:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.304863:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.306647:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.306657:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.306682:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.306687:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.306692:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.306704:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.306713:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.306720:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.306744:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.306928:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.306935:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.306943:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.306947:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.306955:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.306980:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.306988:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df5a6d35/0x6522da1199ce4911 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307003:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.307004:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.307006:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.307281:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.307288:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307296:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.307299:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.307303:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307313:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307330:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307337:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307356:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.307529:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.307534:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307542:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031e00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.307546:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307553:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307574:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307581:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001736eaf1/0x6522da1199ce4918 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307603:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.307605:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.307606:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.307789:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.307795:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307804:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.307807:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.307811:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307821:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307829:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307836:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.307870:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.307952:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.307958:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307965:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031c00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.307969:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307977:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307988:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.307996:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c85c294/0x6522da1199ce491f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.308008:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.308010:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.308012:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.308848:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.308856:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.308865:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.308868:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.308872:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.308893:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.308902:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.308908:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.308923:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789448213.309209:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.309215:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.309222:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.309231:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.309235:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.309244:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.309252:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.309258:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.309270:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789448213.323710:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.323725:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323742:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.323746:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.323753:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323767:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323778:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323797:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323819:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789448213.323831:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448213.323837:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323844:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.323849:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323858:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323873:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323886:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c35f2110/0x6522da1199ce4926 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323903:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.323907:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323924:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.323927:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323935:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323946:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323954:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce492d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323967:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.323970:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323977:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.323980:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323988:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.323996:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.324008:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b69d03/0x6522da1199ce4934 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.324022:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.324024:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.324026:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789448213.324096:0:25065:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789448213.324122:0:25065:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789448213.324127:0:25065:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789448213.324724:0:24250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23488:x1876371859299200:12345-0@lo:5:osp-pre-1-1.0 Request processed in 75976us (81842us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789448213.324734:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:3.0:1789448213.324846:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.324854:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.324875:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.324879:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.324883:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.324894:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.324902:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.324909:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.324924:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789448213.325727:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.325734:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.325744:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.325749:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.325752:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.325762:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.325781:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.325790:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.325799:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789448213.326008:0:23488:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789448213.326017:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c796a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23488:1876371859299200:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789448213.326033:0:23488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789448213.326080:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23488:1876371859299328:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789448213.326127:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.326152:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d41f4840 going to sleep for 11 seconds 00010000:00010000:2.0:1789448213.326166:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.326172:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326180:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.326183:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326192:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326205:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326218:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce493b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326232:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.326235:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326241:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.326244:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326250:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326260:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326267:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce4942 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326279:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.326280:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.326281:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.326287:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.326291:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.326330:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.326340:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326347:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.326350:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.326354:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326362:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326370:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326378:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326391:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.326399:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.326403:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326409:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.326412:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326420:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326436:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326442:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4949 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.326455:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.326479:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.326481:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448213.326807:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299328 00000100:00100000:3.0:1789448213.326815:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299328 00000100:00100000:3.0:1789448213.326855:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789448213.326863:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23488:x1876371859299328:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789448213.326919:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23488:x1876371859299328:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.326927:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789448213.326962:0:23488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7489f80 x1876371859299328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789448229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448213.326972:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23488:1876371859299328:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789448213.326999:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.327184:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327195:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.327198:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.327202:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327222:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327230:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327237:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327258:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.327430:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.327436:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.327444:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.327447:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.327494:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.327507:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.327514:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ee04c4/0x6522da1199ce4950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.327529:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.327531:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.327532:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448213.327858:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.327865:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327874:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.327877:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1789448213.327924:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.327932:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.327940:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.327943:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.327948:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327948:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.327960:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327960:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.327970:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327970:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.327977:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.327988:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.328008:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789448213.329874:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.329885:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.329899:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.329902:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.329908:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.329919:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.329929:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.329936:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.335125:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789448213.335542:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789448213.335575:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335588:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.335593:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335603:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335621:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335649:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5149833/0x6522da1199ce495e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335667:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448213.335671:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335677:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e400 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.335680:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335687:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335697:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335704:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ebe7f6e/0x6522da1199ce4957 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335716:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.335720:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335726:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.335735:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335742:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335752:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.335760:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.335762:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.335764:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448213.335970:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.335977:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.335988:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.335992:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.335997:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336007:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336015:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336022:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336044:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789448213.336355:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.336371:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336395:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.336399:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.336403:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336412:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336421:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336428:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336440:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789448213.336480:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789448213.336486:0:25215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a215fef8/0x6522da1199ce4965 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336508:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.336513:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336524:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75fe00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.336528:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336536:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336547:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336571:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a667ce0/0x6522da1199ce496c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336585:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.336588:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336594:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75e800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.336597:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336605:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336616:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.336629:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd4dddda/0x6522da1199ce4973 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448213.336900:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.336906:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336914:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.336918:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.336921:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336931:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336950:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336957:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.336966:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.337170:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.337175:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337182:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207be00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.337185:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337192:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337204:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337211:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004094ed3f/0x6522da1199ce497a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337224:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.337226:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.337228:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.337421:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.337427:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448213.337748:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.337756:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.337764:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.337766:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.337771:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.337780:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.337788:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.337796:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.337822:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.337851:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.337856:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337869:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207b200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.337872:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337880:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337891:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337898:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000649796c8/0x6522da1199ce4981 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337912:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.337913:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.337915:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789448213.337959:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789448213.337965:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337972:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1789448213.337975:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448213.337979:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.337990:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.338002:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.338009:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.338029:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789448213.338133:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.338138:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.338145:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.338149:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.338157:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.338168:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.338185:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f45112ab/0x6522da1199ce4988 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.338198:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.338200:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.338202:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.339719:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.339729:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.339741:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.339745:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.339749:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.339760:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.339767:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.339774:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.339795:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789448213.339993:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.340000:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.340008:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.340010:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.340014:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.340023:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.340030:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.340042:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.340063:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789448213.340192:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.340199:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340206:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.340210:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340217:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340238:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340252:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088e53333/0x6522da1199ce498f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340268:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.340278:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340284:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0030a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.340287:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340293:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340303:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340309:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065b95b3b/0x6522da1199ce4996 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.340323:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.340324:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.340326:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.340359:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.340787:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.340794:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.340803:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.340806:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.340810:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.340819:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.340827:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.340835:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.340851:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.341435:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.341441:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.341449:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.341452:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.341494:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.341507:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.341514:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcba57e3/0x6522da1199ce499d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.341528:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.341530:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.341532:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.341802:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.341808:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.341817:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.341820:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.341824:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.341833:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.341842:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.341849:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.341870:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.342000:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.342006:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342013:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.342016:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342024:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342034:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342053:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5bceabe/0x6522da1199ce49a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342067:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.342069:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.342070:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.342508:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.342515:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.342523:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.342526:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.342530:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.342568:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.342577:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.342584:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.342599:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.342870:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.342875:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342883:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.342886:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342894:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342906:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342913:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87a404e/0x6522da1199ce49ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.342927:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.342929:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.342931:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.343486:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.343493:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.343507:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.343511:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.343515:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.343524:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.343532:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.343540:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.343628:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.343886:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.343892:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.343900:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0030200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.343903:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.343911:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.343923:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.343930:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000333f4044/0x6522da1199ce49b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.343943:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.343945:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.343947:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789448213.344872:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.344880:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.344890:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.344893:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.344898:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.344908:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.344928:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.344935:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.344995:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789448213.346247:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789448213.346256:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.346265:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=615s v=(0 0) 00010000:00010000:1.0:1789448213.346269:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448213.346273:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.346290:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.346299:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448213.346306:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789448213.346525:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.346532:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.346540:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.346543:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.346547:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.346662:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.346670:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.346689:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349189:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789448213.349201:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349213:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.349217:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349240:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349259:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349265:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a9c67e/0x6522da1199ce49b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349284:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789448213.349288:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349294:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.349297:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349304:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349313:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349331:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.349335:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349347:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.349351:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349358:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349369:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.349378:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.349380:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.349382:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789448213.350980:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789448213.350990:0:24251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c35f2110/0x6522da1199ce49c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.351673:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789448213.351681:0:25215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f213f32b/0x6522da1199ce49c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.351910:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.352385:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.352840:0:24251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.352848:0:24251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.352862:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.352866:0:24251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.352872:0:24251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.352885:0:24251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.352895:0:24251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.352902:0:24251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.352936:0:24251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789448213.352975:0:24251:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1789448213.353059:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22771:x1876371859298432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 152557us (152722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.353069:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448213.353264:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7050700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22771:1876371859298432:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789448213.353280:0:22771:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1789448213.353323:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22771:1876371859299456:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789448213.353357:0:22771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448213.353403:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517e02c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448213.353806:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299456 00000100:00100000:3.0:1789448213.353813:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299456 00000100:00100000:3.0:1789448213.353896:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789448213.353905:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22771:x1876371859299456:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789448213.353937:0:24249:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1789448213.355176:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.355187:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.355198:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a800 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.355203:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.355213:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.355229:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.355246:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38a493b/0x6522da1199ce49ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.355263:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.355265:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.355267:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.355733:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.355740:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.355751:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.355755:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.355761:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.355772:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.355781:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.355800:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.355817:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789448213.356059:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448213.356066:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.356074:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477ae00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:0.0:1789448213.356078:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.356084:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.356096:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.356102:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022fd9674/0x6522da1199ce49d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.356127:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.356128:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448213.356130:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.359516:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.359527:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.359542:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.359547:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.359552:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.359576:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.359587:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.359594:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.359614:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789448213.363151:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1876371859299456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9242us (9787us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789448213.363162:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789448213.363305:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22771:1876371859299456:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789448213.363321:0:22771:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1789448213.368502:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448213.368514:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.368541:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477aa00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:3.0:1789448213.368546:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.368557:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.368585:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.368593:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b77a272/0x6522da1199ce49dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.368619:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.368622:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448213.368623:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789448213.369543:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789448213.369553:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.369574:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1789448213.369579:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448213.369584:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.369596:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.369605:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.369612:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448213.370334:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.373845:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.373859:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.373872:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207a200 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.373877:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.373888:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.373909:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.373917:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d21b97a6/0x6522da1199ce49e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.373941:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.373943:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.373944:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.374847:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.374856:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.374868:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.374872:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.374878:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.374890:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.374906:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.374914:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.374929:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.375231:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.375237:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375245:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.375250:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375264:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375276:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375284:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f87a404e/0x6522da1199ce49ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375298:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.375300:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.375302:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.375319:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.375325:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.375334:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.375337:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.375341:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.375350:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.375357:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.375377:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.375414:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.375724:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.375730:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375738:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.375741:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375762:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375773:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375781:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcba57e3/0x6522da1199ce49f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.375795:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.375797:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.375799:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.376179:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.376186:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376196:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.376199:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.376203:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376212:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376220:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376228:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376251:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789448213.376382:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.376388:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.376396:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477b000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.376399:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.376408:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.376419:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.376437:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e53333/0x6522da1199ce49f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.376451:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.376453:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.376454:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789448213.376741:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789448213.376747:0:25215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376756:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=615s v=(0 0) 00010000:00010000:3.0:1789448213.376764:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789448213.376769:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376779:0:25215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376788:0:25215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376795:0:25215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448213.376817:0:25215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789448213.377175:0:25215:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1789448213.377250:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22769:x1876371859298688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 139490us (172436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448213.377259:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789448213.377393:0:24277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789448213.377399:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.377408:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d90ef000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448213.377412:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.377420:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.377432:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.377438:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb87845a/0x6522da1199ce49ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448213.377453:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.377455:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448213.377456:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448213.377516:0:22769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c83ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22769:1876371859298688:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789448213.377531:0:22769:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789448213.377581:0:22769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c748a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22769:1876371859299584:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789448213.377613:0:22769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448213.377658:0:22769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d81dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789448213.377677:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299584 00000100:00100000:3.0:1789448213.377684:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299584 00000100:00100000:3.0:1789448213.377727:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789448213.377736:0:24250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22769:x1876371859299584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789448213.377767:0:24250:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1789448213.397016:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789448213.397054:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789448213.397245:0:24250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22769:x1876371859299584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19506us (19626us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789448213.397256:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789448213.397353:0:22769:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789448213.397362:0:22769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c748a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22769:1876371859299584:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789448213.397378:0:22769:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000040:00080000:0.0:1789448213.879054:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448214.134615:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448215.157651:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448216.196904:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448216.759447:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448216.759487:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859299712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789448216.759561:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448216.759622:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299712 00000100:00100000:3.0:1789448216.759630:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299712 00000100:00100000:3.0:1789448216.759681:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789448216.759691:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859299712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789448216.759719:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789448216.759764:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859299712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448216.759772:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789448216.759791:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448216.759824:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859299712:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789448217.208097:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448217.784516:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448217.784548:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517f82c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859299840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789448217.784642:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448217.787360:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299840 00000100:00100000:0.0:1789448217.787370:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299840 00000100:00100000:0.0:1789448217.787447:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789448217.787456:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859299840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448217.787520:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789448217.787606:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859299840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (2963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448217.787613:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789448217.787702:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859299968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789448217.787741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448217.787791:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517f82c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859299840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789448217.787815:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859299968 00000100:00100000:1.0:1789448217.787818:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859299968 00000100:00100000:1.0:1789448217.787846:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789448217.787852:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859299968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789448217.787866:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789448217.787910:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859299968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448217.787916:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789448217.787961:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859299968:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1789448217.800843:0:25422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg638-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789448218.229651:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448218.293738:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789448218.293759:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859300096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448218.293823:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.293869:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300096 00000100:00100000:0.0:1789448218.293877:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300096 00000100:00100000:0.0:1789448218.293941:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789448218.293950:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1876371859300096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448218.293978:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789448218.294031:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1876371859300096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.294039:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789448218.294058:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448218.294105:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859300096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448218.294329:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448218.294339:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859300224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789448218.294372:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448218.294441:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300224 00000100:00100000:3.0:1789448218.294446:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300224 00000100:00100000:3.0:1789448218.294495:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448218.294502:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859300224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789448218.294513:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789448218.294561:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859300224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448218.294567:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789448218.294595:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859300224:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789448218.294647:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448218.294899:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789448218.294998:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517f82c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859300352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789448218.295028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.295196:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859300864:0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.295240:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859301376:0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295260:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.295275:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789448218.295280:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859300480:0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295303:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.295323:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859300992:0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295339:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.295358:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300864 00000100:00100000:0.0:1789448218.295373:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300864 00000100:00100000:0.0:1789448218.295397:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301376 00000100:00100000:0.0:1789448218.295399:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301376 00000100:00100000:0.0:1789448218.295414:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300992 00000100:00100000:0.0:1789448218.295417:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300992 00000100:00100000:0.0:1789448218.295429:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789448218.295436:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859300864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295487:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859300864:12345-0@lo:400:kworker.0 Request processed in 51us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.295494:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789448218.295506:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789448218.295512:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876371859301376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295546:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876371859301376:12345-0@lo:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.295552:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789448218.295569:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789448218.295575:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859300992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295602:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859300992:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.295608:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789448218.295624:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300480 00000100:00100000:0.0:1789448218.295627:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300480 00000100:00100000:0.0:1789448218.295649:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789448218.295654:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3634:x1876371859300480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.295679:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3634:x1876371859300480:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.295684:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789448218.295706:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448218.295709:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789448218.295723:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859300480:0@lo:400:kworker.0 00010000:00080000:0.0:1789448218.295734:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7489180 x1876371859300992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448218.295745:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859300992:0@lo:400:kworker.0 00010000:00080000:0.0:1789448218.295759:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7488a80 x1876371859300864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448218.295767:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859300864:0@lo:400:kworker.0 00010000:00080000:0.0:1789448218.295779:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7488380 x1876371859301376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448218.295788:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859301376:0@lo:400:kworker.0 00000100:00100000:3.0:1789448218.295807:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300352 00000100:00100000:3.0:1789448218.295813:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300352 00000100:00080000:0.0:1789448218.295831:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448218.295850:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789448218.295859:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859300352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789448218.295877:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448218.296133:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859300608:0@lo:400:kworker.0 00000100:00100000:3.0:1789448218.296141:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859300352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 282us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448218.296159:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789448218.296166:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448218.296285:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517f82c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859300352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448218.296371:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859301120:0@lo:400:kworker.0 00000100:00100000:2.0:1789448218.296392:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448218.296547:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789448218.296554:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859300736:0@lo:400:kworker.0 00000100:00100000:2.0:1789448218.296602:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448218.296653:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859301248:0@lo:400:kworker.0 00000100:00100000:1.0:1789448218.296702:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300736 00000100:00100000:1.0:1789448218.296706:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300736 00000100:00100000:1.0:1789448218.296737:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789448218.296742:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448218.296771:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859300736:12345-0@lo:400:kworker.0 Request processed in 29us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448218.296777:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789448218.296792:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448218.297175:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859300608 00000100:00100000:0.0:1789448218.297180:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859300608 00000100:00100000:0.0:1789448218.297209:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301120 00000100:00100000:0.0:1789448218.297212:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301120 00000100:00100000:0.0:1789448218.297231:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789448218.297236:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859300608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.297266:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859300608:12345-0@lo:400:kworker.0 Request processed in 30us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.297272:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789448218.297282:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789448218.297287:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859301120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.297308:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859301120:12345-0@lo:400:kworker.0 Request processed in 21us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.297313:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789448218.297328:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789448218.297330:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789448218.297533:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c748b800 x1876371859300608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448218.297556:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859300608:0@lo:400:kworker.0 00010000:00080000:2.0:1789448218.297566:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c748a680 x1876371859301120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448218.297574:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859301120:0@lo:400:kworker.0 00000100:00100000:2.0:1789448218.297590:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859300736:0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.297636:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301248 00000100:00100000:0.0:1789448218.297640:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301248 00000100:00100000:0.0:1789448218.297711:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789448218.297717:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859301248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448218.297749:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859301248:12345-0@lo:400:kworker.0 Request processed in 33us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448218.297755:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789448218.297814:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c7488700 x1876371859301248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448218.297823:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859301248:0@lo:400:kworker.0 00000100:00080000:1.0:1789448218.297862:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1789448218.806592:0:25475:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789448218.808270:0:25475:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1789448218.809040:0:25065:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1789448219.256719:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789448219.997135:0:25525:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789448219.997386:0:25525:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789448220.281479:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448220.420558:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.420904:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849758848 00000100:00100000:2.0:1789448220.420913:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849758848 00000100:00100000:2.0:1789448220.420967:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 115 00000100:00100000:2.0:1789448220.420975:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2388:x1876371849758848:12345-192.168.206.38@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789448220.421001:0:22740:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bb619d97-77c9-4e42-a2f4-6c7905f1c791@192.168.206.38@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1789448220.421029:0:22740:0:(genops.c:1384:class_connect()) connect: client bb619d97-77c9-4e42-a2f4-6c7905f1c791, cookie 0x6522da1199ce4a06 00000100:00080000:2.0:1789448220.421183:0:22740:0:(import.c:65:import_set_state_nolock()) ffff9517d134e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448220.421256:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+5:2388:x1876371849758848:12345-192.168.206.38@tcp:250:mount.lustre.0 Request processed in 280us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.421265:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 115 00000100:00100000:0.0:1789448220.427138:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448220.427329:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849758976 00000100:00100000:3.0:1789448220.427339:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849758976 00000100:00100000:3.0:1789448220.427402:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 116 00000100:00100000:3.0:1789448220.427413:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+5:18099:x1876371849758976:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789448220.427429:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448220.427457:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517d90ef400/0x6522da1199ce4a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb87132 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448220.427509:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517d90ef400/0x6522da1199ce4a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87132 expref: 6 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448220.427520:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517d90ef400/0x6522da1199ce4a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87132 expref: 6 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448220.427542:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ef400, rc 0) 00000100:00100000:3.0:1789448220.427602:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+6:18099:x1876371849758976:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 192us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.427609:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 116 00000100:00100000:3.0:1789448220.450222:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.450390:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759104 00000100:00100000:0.0:1789448220.450400:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759104 00000100:00100000:0.0:1789448220.450502:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 117 00000100:00100000:0.0:1789448220.450512:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+6:18099:x1876371849759104:12345-192.168.206.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789448220.450656:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+6:18099:x1876371849759104:12345-192.168.206.38@tcp:501:mount.lustre.0 Request processed in 145us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789448220.450665:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 117 00000100:00100000:0.0:1789448220.455331:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.455548:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759232 00000100:00100000:2.0:1789448220.455559:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759232 00000100:00100000:2.0:1789448220.455765:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 118 00000100:00100000:2.0:1789448220.455775:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+6:18099:x1876371849759232:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789448220.455791:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448220.455808:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517fd7e8600/0x6522da1199ce4a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb87139 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.455835:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd7e8600/0x6522da1199ce4a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87139 expref: 7 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.455846:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517fd7e8600/0x6522da1199ce4a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87139 expref: 7 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448220.455869:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8600, rc 0) 00000100:00100000:2.0:1789448220.455931:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+7:18099:x1876371849759232:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 157us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.456060:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 118 00000100:00100000:1.0:1789448220.463725:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448220.463810:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759360 00000100:00100000:3.0:1789448220.463820:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759360 00000100:00100000:3.0:1789448220.463883:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 119 00000100:00100000:3.0:1789448220.463894:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+7:18099:x1876371849759360:12345-192.168.206.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789448220.464072:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18099:x1876371849759360:12345-192.168.206.38@tcp:501:mount.lustre.0 Request processed in 179us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.464080:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 119 00000100:00100000:3.0:1789448220.475981:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.476500:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759488 00000100:00100000:2.0:1789448220.476510:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759488 00000100:00100000:2.0:1789448220.476658:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 120 00000100:00100000:2.0:1789448220.476669:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18099:x1876371849759488:12345-192.168.206.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789448220.477642:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18099:x1876371849759488:12345-192.168.206.38@tcp:503:mount.lustre.0 Request processed in 163us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.477652:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 120 00000100:00100000:1.0:1789448220.486772:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.487145:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759616 00000100:00100000:0.0:1789448220.487164:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759616 00000100:00100000:0.0:1789448220.487222:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 121 00000100:00100000:0.0:1789448220.487232:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18118:x1876371849759616:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448220.487374:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18118:x1876371849759616:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 143us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.487382:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 121 00000100:00100000:1.0:1789448220.549025:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448220.549310:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759744 00000100:00100000:3.0:1789448220.549321:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759744 00000100:00100000:3.0:1789448220.549395:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 122 00000100:00100000:3.0:1789448220.549405:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18118:x1876371849759744:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789448220.549604:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18118:x1876371849759744:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 201us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.549612:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 122 00000100:00100000:3.0:1789448220.558011:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.561101:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849759872 00000100:00100000:2.0:1789448220.561121:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849759872 00000100:00100000:2.0:1789448220.561268:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 123 00000100:00100000:2.0:1789448220.561281:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18118:x1876371849759872:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448220.567707:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18118:x1876371849759872:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 6417us (9694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.567722:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 123 00000100:00100000:1.0:1789448220.574711:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.575672:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760000 00000100:00100000:0.0:1789448220.575683:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760000 00000100:00100000:0.0:1789448220.575740:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 124 00000100:00100000:0.0:1789448220.575750:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+8:18099:x1876371849760000:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448220.575765:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448220.575781:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207b200/0x6522da1199ce4a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb8716a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.575809:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207b200/0x6522da1199ce4a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8716a expref: 9 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.575821:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207b200/0x6522da1199ce4a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8716a expref: 9 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.575863:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207b200, rc 0) 00000100:00100000:0.0:1789448220.577954:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+9:18099:x1876371849760000:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 2195us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.577966:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 124 00000100:00100000:0.0:1789448220.589335:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.589853:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760128 00000100:00100000:2.0:1789448220.589863:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760128 00000100:00100000:2.0:1789448220.589922:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 125 00000100:00100000:2.0:1789448220.589933:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+9:18099:x1876371849760128:12345-192.168.206.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789448220.589958:0:22740:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789448220.589987:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789448220.589997:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789448220.590000:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789448220.590003:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789448220.590006:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789448220.594561:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+9:18099:x1876371849760128:12345-192.168.206.38@tcp:256:mount.lustre.0 Request processed in 4620us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.594576:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 125 00000100:00100000:1.0:1789448220.597913:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.598000:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760256 00000100:00100000:0.0:1789448220.598010:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760256 00000100:00100000:0.0:1789448220.598057:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 126 00000100:00100000:0.0:1789448220.598070:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+9:18099:x1876371849760256:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448220.598085:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448220.598103:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb87171 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.598130:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 10 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.598142:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 10 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448220.598151:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207be00, rc 0) 00000100:00100000:0.0:1789448220.598216:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18099:x1876371849760256:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 151us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.598224:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 126 00000100:00100000:0.0:1789448220.600945:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.605580:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760384 00000100:00100000:2.0:1789448220.605596:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760384 00000100:00100000:2.0:1789448220.605664:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 127 00000100:00100000:2.0:1789448220.605673:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18099:x1876371849760384:12345-192.168.206.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789448220.605898:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18099:x1876371849760384:12345-192.168.206.38@tcp:501:mount.lustre.0 Request processed in 225us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.605906:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 127 00000100:00100000:1.0:1789448220.617828:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448220.617967:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760512 00000100:00100000:3.0:1789448220.617977:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760512 00000100:00100000:3.0:1789448220.618037:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 128 00000100:00100000:3.0:1789448220.618048:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c69d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18099:x1876371849760512:12345-192.168.206.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789448220.618680:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c69d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18099:x1876371849760512:12345-192.168.206.38@tcp:503:mount.lustre.0 Request processed in 148us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.618692:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 128 00000100:00100000:1.0:1789448220.625328:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.625491:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760640 00000100:00100000:0.0:1789448220.625501:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760640 00000100:00100000:0.0:1789448220.625568:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 129 00000100:00100000:0.0:1789448220.625578:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c69d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18123:x1876371849760640:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448220.625715:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c69d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18123:x1876371849760640:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 138us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448220.625723:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 129 00000100:00100000:0.0:1789448220.638503:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.638718:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760768 00000100:00100000:2.0:1789448220.638730:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760768 00000100:00100000:2.0:1789448220.638794:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 130 00000100:00100000:2.0:1789448220.638805:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18123:x1876371849760768:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448220.638972:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18123:x1876371849760768:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 168us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.638980:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 130 00000100:00100000:1.0:1789448220.646555:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448220.646599:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.646941:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849760896 00000100:00100000:0.0:1789448220.646951:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849760896 00000100:00100000:0.0:1789448220.646996:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761152 00000100:00100000:0.0:1789448220.646999:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761152 00000100:00100000:0.0:1789448220.647025:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:0.0:1789448220.647034:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876371849760896:12345-192.168.206.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789448220.647063:0:22745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fe0e289e-d7a2-4039-8365-2f54416a41ea@192.168.206.38@tcp t0 exp 0000000000000000 cur 622 last 0 00000100:00100000:3.0:1789448220.647401:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 8 00000100:00100000:3.0:1789448220.647408:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876371849761152:12345-192.168.206.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789448220.647424:0:22746:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fe0e289e-d7a2-4039-8365-2f54416a41ea@192.168.206.38@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:3.0:1789448220.647505:0:22746:0:(genops.c:1384:class_connect()) connect: client fe0e289e-d7a2-4039-8365-2f54416a41ea, cookie 0x6522da1199ce4a29 00000004:00100000:3.0:1789448220.647539:0:22746:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789448220.647749:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9517d132a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448220.647812:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2388:x1876371849761152:12345-192.168.206.38@tcp:38:mount.lustre.0 Request processed in 402us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.647820:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 8 00000020:00000080:0.0:1789448220.648347:0:22745:0:(genops.c:1384:class_connect()) connect: client fe0e289e-d7a2-4039-8365-2f54416a41ea, cookie 0x6522da1199ce4a30 00000004:00100000:0.0:1789448220.648363:0:22745:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789448220.650053:0:22745:0:(import.c:65:import_set_state_nolock()) ffff9517d132f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448220.650390:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2388:x1876371849760896:12345-192.168.206.38@tcp:38:mount.lustre.0 Request processed in 3353us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.650403:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:1.0:1789448220.660429:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448220.660513:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448220.660561:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448220.660712:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761280 00000100:00100000:3.0:1789448220.660723:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761280 00000100:00100000:3.0:1789448220.660781:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761024 00000100:00100000:3.0:1789448220.660785:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761024 00000100:00100000:3.0:1789448220.660799:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761408 00000100:00100000:3.0:1789448220.660802:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761408 00000100:00100000:3.0:1789448220.660815:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 9 00000100:00100000:3.0:1789448220.660825:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:0:x1876371849761280:12345-192.168.206.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789448220.660875:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789448220.660951:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:0:x1876371849761280:12345-192.168.206.38@tcp:41:mount.lustre.0 Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.660958:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 9 00000100:00100000:3.0:1789448220.660975:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:3.0:1789448220.660981:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:0:x1876371849761024:12345-192.168.206.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789448220.660998:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789448220.661034:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:0:x1876371849761024:12345-192.168.206.38@tcp:41:mount.lustre.0 Request processed in 53us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.661040:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:3.0:1789448220.661066:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 11 00000100:00100000:3.0:1789448220.661072:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849761408:12345-192.168.206.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789448220.661082:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789448220.661102:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849761408:12345-192.168.206.38@tcp:41:mount.lustre.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.661107:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 11 00000040:00080000:3.0:1789448220.662569:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789448220.663174:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448220.663179:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789448220.670798:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448220.671008:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761536 00000100:00100000:3.0:1789448220.671018:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761536 00000100:00100000:3.0:1789448220.671085:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 12 00000100:00100000:3.0:1789448220.671335:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849761536:12345-192.168.206.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789448220.671414:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849761536:12345-192.168.206.38@tcp:40:mount.lustre.0 Request processed in 320us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.671422:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 12 00000100:00100000:0.0:1789448220.689328:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.689371:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448220.689414:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448220.689506:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761664 00000100:00100000:1.0:1789448220.689516:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761664 00000100:00100000:1.0:1789448220.689564:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761792 00000100:00100000:1.0:1789448220.689568:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761792 00000100:00100000:2.0:1789448220.689581:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 16 00000100:00100000:2.0:1789448220.689593:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1876371849761664:12345-192.168.206.38@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789448220.689593:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 17 00000100:00100000:1.0:1789448220.689603:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876371849761792:12345-192.168.206.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789448220.689631:0:24251:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fe0e289e-d7a2-4039-8365-2f54416a41ea@192.168.206.38@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1789448220.689662:0:24251:0:(genops.c:1384:class_connect()) connect: client fe0e289e-d7a2-4039-8365-2f54416a41ea, cookie 0x6522da1199ce4a37 00000100:00100000:3.0:1789448220.689669:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849761920 00000100:00100000:3.0:1789448220.689675:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849761920 00002000:00100000:2.0:1789448220.689675:0:24251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fe0e289e-d7a2-4039-8365-2f54416a41ea/ffff9517d134a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789448220.689705:0:24251:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:3.0:1789448220.689710:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 3 00000100:00100000:3.0:1789448220.689718:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849761920:12345-192.168.206.38@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789448220.689783:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849761920:12345-192.168.206.38@tcp:900:mount.lustre.0 Request processed in 65us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448220.689792:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 3 00002000:00080000:2.0:1789448220.689882:0:24251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789448220.689922:0:24251:0:(import.c:65:import_set_state_nolock()) ffff9517d134e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789448220.689955:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2388:x1876371849761664:12345-192.168.206.38@tcp:8:mount.lustre.0 Request processed in 364us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.689962:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 16 00000100:00100000:3.0:1789448220.693422:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448220.693612:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762048 00000100:00100000:2.0:1789448220.693622:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762048 00000100:00100000:2.0:1789448220.693680:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 0 00000100:00100000:2.0:1789448220.693691:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849762048:12345-192.168.206.38@tcp:33:mount.lustre.0 00010000:00080000:1.0:1789448220.699386:0:25215:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fe0e289e-d7a2-4039-8365-2f54416a41ea@192.168.206.38@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:1.0:1789448220.699421:0:25215:0:(genops.c:1384:class_connect()) connect: client fe0e289e-d7a2-4039-8365-2f54416a41ea, cookie 0x6522da1199ce4a3e 00002000:00100000:1.0:1789448220.699433:0:25215:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fe0e289e-d7a2-4039-8365-2f54416a41ea/ffff9516c5be6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789448220.699451:0:25215:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789448220.699663:0:25215:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789448220.699697:0:25215:0:(import.c:65:import_set_state_nolock()) ffff9516c5be2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789448220.699769:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2388:x1876371849761792:12345-192.168.206.38@tcp:8:mount.lustre.0 Request processed in 10165us (10352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448220.699780:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 17 00000004:00080000:1.0:1789448220.700771:0:22747:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6998us 00000004:00200000:2.0:1789448220.747964:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789448220.748080:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18099:x1876371849762048:12345-192.168.206.38@tcp:33:mount.lustre.0 Request processed in 54386us (54662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448220.748090:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 0 00000100:00100000:3.0:1789448221.036750:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448221.037275:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762176 00000100:00100000:0.0:1789448221.037285:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762176 00000100:00100000:0.0:1789448221.037346:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 13 00000100:00100000:0.0:1789448221.037356:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18146:x1876371849762176:12345-192.168.206.38@tcp:101:mkdir.0 00010000:00010000:0.0:1789448221.037375:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448221.037423:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95180207ba00/0x6522da1199ce4a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb871a2 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.037540:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95180207a800/0x6522da1199ce4a4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.037566:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95180207a800/0x6522da1199ce4a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.037581:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95180207a800/0x6522da1199ce4a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448221.037628:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789448221.037632:0:24273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789448221.037666:0:24273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95180207a800/0x6522da1199ce4a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.037690:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95180207ba00/0x6522da1199ce4a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871a2 expref: 8 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.037709:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95180207a800/0x6522da1199ce4a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871a2 expref: 7 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448221.037718:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:0.0:1789448221.037722:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448221.037726:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207a800, rc 0) 00000100:00100000:0.0:1789448221.037796:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18146:x1876371849762176:12345-192.168.206.38@tcp:101:mkdir.0 Request processed in 441us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448221.037802:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 13 00010000:00010000:2.0:1789448221.301802:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448221.877771:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448221.877793:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859301504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789448221.877875:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448221.878022:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301504 00000100:00100000:0.0:1789448221.878030:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301504 00000100:00100000:0.0:1789448221.878097:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448221.878107:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859301504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789448221.878145:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789448221.878202:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859301504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448221.878208:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789448221.878484:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448221.878533:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859301504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789448222.327200:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448222.902068:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859301760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789448222.902136:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448222.902193:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517f82c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859301632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448222.902240:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448222.902384:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301632 00000100:00100000:0.0:1789448222.902384:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301760 00000100:00100000:1.0:1789448222.902392:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301632 00000100:00100000:0.0:1789448222.902392:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301760 00000100:00100000:0.0:1789448222.902440:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789448222.902445:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789448222.902449:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859301760:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789448222.902456:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859301632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789448222.902500:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000004:00000024:0.0:1789448222.902500:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789448222.902554:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859301632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448222.902561:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789448222.910743:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859301760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8284us (8596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448222.910758:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789448222.911150:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859301760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448222.911166:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517f82c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859301632:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789448223.095054:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789448223.248939:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.249164:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762304 00000100:00100000:3.0:1789448223.249174:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762304 00000100:00100000:3.0:1789448223.249252:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 14 00000100:00100000:3.0:1789448223.249262:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18198:x1876371849762304:12345-192.168.206.38@tcp:41:lfs.0 00000004:00000024:3.0:1789448223.249290:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1789448223.249542:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789448223.249648:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18198:x1876371849762304:12345-192.168.206.38@tcp:41:lfs.0 Request processed in 387us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.249656:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 14 00000100:00100000:3.0:1789448223.256812:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.257072:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762432 00000100:00100000:0.0:1789448223.257082:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762432 00000100:00100000:0.0:1789448223.257170:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 15 00000100:00100000:0.0:1789448223.257182:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18198:x1876371849762432:12345-192.168.206.38@tcp:41:lfs.0 00000004:00000024:0.0:1789448223.257214:0:24273:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448223.257315:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18198:x1876371849762432:12345-192.168.206.38@tcp:41:lfs.0 Request processed in 136us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.257334:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 15 00000100:00080000:2.0:1789448223.258073:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789448223.268249:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.268364:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762560 00000100:00100000:2.0:1789448223.268374:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762560 00000100:00100000:2.0:1789448223.268449:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:2.0:1789448223.268521:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18198:x1876371849762560:12345-192.168.206.38@tcp:13:lfs.0 00002000:00000024:2.0:1789448223.268548:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448223.268625:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18198:x1876371849762560:12345-192.168.206.38@tcp:13:lfs.0 Request processed in 167us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.268633:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00080000:1.0:1789448223.269102:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789448223.272049:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.272186:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762688 00000100:00100000:2.0:1789448223.272196:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762688 00000100:00100000:2.0:1789448223.272269:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 11 00000100:00100000:2.0:1789448223.272279:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18198:x1876371849762688:12345-192.168.206.38@tcp:13:lfs.0 00002000:00000024:2.0:1789448223.272324:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00080000:1.0:1789448223.272480:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448223.272662:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18198:x1876371849762688:12345-192.168.206.38@tcp:13:lfs.0 Request processed in 383us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.272670:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 11 00010000:00010000:3.0:1789448223.349803:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448223.413769:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859301888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789448223.413849:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448223.414129:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859301888 00000100:00100000:3.0:1789448223.414138:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859301888 00000100:00100000:3.0:1789448223.414197:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448223.414205:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859301888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789448223.414226:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789448223.414267:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859301888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.414274:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789448223.414346:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448223.414646:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859302144:0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.414680:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448223.414702:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859302656:0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.414724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448223.414755:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3635:1876371859303168:0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.414776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448223.414796:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789448223.414801:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859302016:0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.414848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448223.414884:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859302528:0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.414906:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448223.414919:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3635:1876371859303040:0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.414943:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448223.414968:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302144 00000100:00100000:0.0:1789448223.414973:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302144 00000100:00100000:0.0:1789448223.415006:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302528 00000100:00100000:0.0:1789448223.415009:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302528 00000100:00100000:0.0:1789448223.415027:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448223.415033:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859302144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.415066:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859302144:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.415072:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789448223.415085:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448223.415092:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859302528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.415117:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859302528:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.415122:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789448223.415145:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302656 00000100:00100000:0.0:1789448223.415148:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302656 00000100:00100000:0.0:1789448223.415170:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303168 00000100:00100000:0.0:1789448223.415173:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303168 00000100:00100000:0.0:1789448223.415196:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303040 00000100:00100000:0.0:1789448223.415199:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303040 00000100:00100000:0.0:1789448223.415214:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448223.415219:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859302656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.415248:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876371859302656:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.415253:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789448223.415263:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448223.415268:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876371859303168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448223.415290:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876371859303168:12345-0@lo:400:kworker.0 Request processed in 22us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.415294:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789448223.415302:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789448223.415307:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876371859303040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.415699:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859302272:0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.415728:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448223.415746:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859302784:0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.415767:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448223.415779:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789448223.415785:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859302400:0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.415804:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448223.415845:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859302912:0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.415867:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448223.415886:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302784 00000100:00100000:3.0:1789448223.415890:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302784 00000100:00100000:3.0:1789448223.415910:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302400 00000100:00100000:3.0:1789448223.415913:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302400 00000100:00100000:3.0:1789448223.415922:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302912 00000100:00100000:3.0:1789448223.415925:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302912 00000100:00100000:3.0:1789448223.415953:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789448223.415959:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859302784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.415995:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859302784:12345-0@lo:400:kworker.0 Request processed in 36us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.416001:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789448223.416014:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789448223.416020:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859302400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.416047:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859302400:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.416053:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789448223.416064:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789448223.416070:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859302912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.416094:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859302912:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.416100:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789448223.416133:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859302400:0@lo:400:kworker.0 00010000:00080000:3.0:1789448223.416145:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c6410700 x1876371859302912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789448223.416167:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859302912:0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.416179:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859302784:0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.416205:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302016 00000100:00100000:3.0:1789448223.416208:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302016 00000100:00100000:3.0:1789448223.416235:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789448223.416242:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3635:x1876371859302016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448223.416271:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3635:x1876371859302016:12345-0@lo:400:kworker.0 Request processed in 30us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.416278:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789448223.416663:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859302272 00000100:00100000:2.0:1789448223.416667:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859302272 00000100:00100000:2.0:1789448223.416696:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448223.416703:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859302272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448223.416739:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859302272:12345-0@lo:400:kworker.0 Request processed in 37us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.416745:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789448223.416786:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859301888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789448223.416798:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448223.416804:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c748a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859303296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448223.416849:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448223.416878:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303296 00000100:00100000:2.0:1789448223.416882:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303296 00000100:00100000:2.0:1789448223.416899:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448223.416905:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859303296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448223.416916:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448223.416947:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859303296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.416953:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789448223.416980:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c748a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859303296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448223.417001:0:3632:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789448223.417010:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859302272:0@lo:400:kworker.0 00000100:00100000:2.0:1789448223.417114:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859302016:0@lo:400:kworker.0 00000100:00100000:2.0:1789448223.417126:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859302528:0@lo:400:kworker.0 00000100:00100000:2.0:1789448223.417136:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859302144:0@lo:400:kworker.0 00000100:00100000:2.0:1789448223.417146:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876371859302656:0@lo:400:kworker.0 00010000:00080000:2.0:1789448223.417157:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c6410000 x1876371859303168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789448223.417165:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3635:1876371859303168:0@lo:400:kworker.0 00000100:00100000:1.0:1789448223.417400:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789448223.417409:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517f82c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859303424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448223.417436:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448223.417484:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303424 00000100:00100000:1.0:1789448223.417488:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303424 00000100:00100000:1.0:1789448223.417524:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789448223.417532:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859303424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789448223.417543:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789448223.417575:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859303424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448223.417581:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789448223.417610:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517f82c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859303424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448223.418103:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876371859303040:12345-0@lo:400:kworker.0 Request processed in 2793us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.418110:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789448223.418156:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448223.418162:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448223.418165:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789448223.418167:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448223.419170:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3635:1876371859303040:0@lo:400:kworker.0 00000100:00100000:2.0:1789448223.522289:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.522496:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762816 00000100:00100000:0.0:1789448223.522506:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762816 00000100:00100000:0.0:1789448223.522578:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 132 00000100:00100000:0.0:1789448223.522588:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+10:18229:x1876371849762816:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448223.522605:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448223.522624:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207b400/0x6522da1199ce4a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb871a9 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.522655:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207b400/0x6522da1199ce4a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871a9 expref: 11 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.522678:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207b400/0x6522da1199ce4a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871a9 expref: 11 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.522687:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207b400, rc 0) 00000100:00100000:0.0:1789448223.522753:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18229:x1876371849762816:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 166us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.522760:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 132 00000100:00100000:0.0:1789448223.537277:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.538047:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849762944 00000100:00100000:3.0:1789448223.538058:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849762944 00000100:00100000:3.0:1789448223.538118:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 133 00000100:00100000:3.0:1789448223.538128:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18229:x1876371849762944:12345-192.168.206.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789448223.538270:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18229:x1876371849762944:12345-192.168.206.38@tcp:501:mount.lustre.0 Request processed in 143us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.538277:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 133 00000100:00100000:1.0:1789448223.555349:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.555536:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763072 00000100:00100000:3.0:1789448223.555547:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763072 00000100:00100000:3.0:1789448223.555609:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 134 00000100:00100000:3.0:1789448223.555619:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517cbb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18229:x1876371849763072:12345-192.168.206.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789448223.555757:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517cbb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18229:x1876371849763072:12345-192.168.206.38@tcp:503:mount.lustre.0 Request processed in 138us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.555771:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 134 00000100:00100000:2.0:1789448223.570748:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.575218:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763200 00000100:00100000:0.0:1789448223.575232:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763200 00000100:00100000:0.0:1789448223.575307:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 135 00000100:00100000:0.0:1789448223.575328:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517dab15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18236:x1876371849763200:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448223.575542:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517dab15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18236:x1876371849763200:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 217us (4801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.575550:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 135 00000100:00100000:1.0:1789448223.617846:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.618002:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763328 00000100:00100000:0.0:1789448223.618013:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763328 00000100:00100000:0.0:1789448223.618132:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 136 00000100:00100000:0.0:1789448223.618143:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18236:x1876371849763328:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448223.618293:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18236:x1876371849763328:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 151us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.618302:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 136 00000100:00100000:1.0:1789448223.624684:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.638205:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763456 00000100:00100000:2.0:1789448223.638221:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763456 00000100:00100000:2.0:1789448223.638290:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 137 00000100:00100000:2.0:1789448223.638301:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18236:x1876371849763456:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448223.639699:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18236:x1876371849763456:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 1393us (15017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.639712:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 137 00000100:00100000:3.0:1789448223.644257:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.644858:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763584 00000100:00100000:0.0:1789448223.644868:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763584 00000100:00100000:0.0:1789448223.644926:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 138 00000100:00100000:0.0:1789448223.644951:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18229:x1876371849763584:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448223.644967:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448223.644985:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207a600/0x6522da1199ce4a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb871da expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.645012:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207a600/0x6522da1199ce4a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871da expref: 12 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.645024:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207a600/0x6522da1199ce4a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871da expref: 12 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.645033:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207a600, rc 0) 00000100:00100000:0.0:1789448223.645107:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18229:x1876371849763584:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 157us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.645114:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 138 00000100:00100000:1.0:1789448223.652729:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.653144:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763712 00000100:00100000:2.0:1789448223.653154:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763712 00000100:00100000:2.0:1789448223.653213:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 139 00000100:00100000:2.0:1789448223.653223:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18229:x1876371849763712:12345-192.168.206.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789448223.653247:0:22740:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789448223.653266:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789448223.653270:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789448223.653273:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789448223.653276:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789448223.653278:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789448223.663634:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18229:x1876371849763712:12345-192.168.206.38@tcp:256:mount.lustre.0 Request processed in 10402us (10901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.663650:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 139 00000100:00100000:3.0:1789448223.672859:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.673039:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763840 00000100:00100000:0.0:1789448223.673048:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763840 00000100:00100000:0.0:1789448223.673109:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 140 00000100:00100000:0.0:1789448223.673118:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18229:x1876371849763840:12345-192.168.206.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789448223.673132:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448223.673148:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb871e1 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.673173:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 13 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.673183:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 13 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448223.673208:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207aa00, rc 0) 00000100:00100000:0.0:1789448223.673261:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18229:x1876371849763840:12345-192.168.206.38@tcp:101:mount.lustre.0 Request processed in 144us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.673268:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 140 00000100:00100000:1.0:1789448223.681333:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.681658:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849763968 00000100:00100000:2.0:1789448223.681667:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849763968 00000100:00100000:2.0:1789448223.681718:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 141 00000100:00100000:2.0:1789448223.681729:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18229:x1876371849763968:12345-192.168.206.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789448223.682108:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18229:x1876371849763968:12345-192.168.206.38@tcp:501:mount.lustre.0 Request processed in 379us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.682124:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 141 00000100:00100000:1.0:1789448223.689333:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.689574:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764096 00000100:00100000:3.0:1789448223.689585:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764096 00000100:00100000:3.0:1789448223.689645:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 142 00000100:00100000:3.0:1789448223.689654:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18229:x1876371849764096:12345-192.168.206.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789448223.689786:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18229:x1876371849764096:12345-192.168.206.38@tcp:503:mount.lustre.0 Request processed in 132us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.689793:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 142 00000100:00100000:3.0:1789448223.696498:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.696871:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764224 00000100:00100000:2.0:1789448223.696881:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764224 00000100:00100000:2.0:1789448223.696946:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 143 00000100:00100000:2.0:1789448223.696956:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18242:x1876371849764224:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789448223.697117:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18242:x1876371849764224:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 162us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.697137:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 143 00000100:00100000:1.0:1789448223.703296:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.715080:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764352 00000100:00100000:0.0:1789448223.715096:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764352 00000100:00100000:0.0:1789448223.715163:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 144 00000100:00100000:0.0:1789448223.715173:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18242:x1876371849764352:12345-192.168.206.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789448223.716036:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18242:x1876371849764352:12345-192.168.206.38@tcp:502:llog_process_th.0 Request processed in 860us (12745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.716047:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 144 00000100:00100000:1.0:1789448223.735344:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448223.735395:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.735923:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764480 00000100:00100000:3.0:1789448223.735933:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764480 00000100:00100000:3.0:1789448223.735975:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764736 00000100:00100000:3.0:1789448223.735978:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764736 00000100:00100000:3.0:1789448223.735996:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 16 00000100:00100000:3.0:1789448223.736004:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876371849764480:12345-192.168.206.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789448223.736033:0:22746:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7a3f413d-b754-460c-ba19-98579d387b28@192.168.206.38@tcp t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:3.0:1789448223.736066:0:22746:0:(genops.c:1384:class_connect()) connect: client 7a3f413d-b754-460c-ba19-98579d387b28, cookie 0x6522da1199ce4a68 00000004:00100000:3.0:1789448223.736089:0:22746:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789448223.736177:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9517f23bf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448223.736238:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:2388:x1876371849764480:12345-192.168.206.38@tcp:38:mount.lustre.0 Request processed in 233us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.736246:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 16 00000100:00100000:3.0:1789448223.736262:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 17 00000100:00100000:3.0:1789448223.736279:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876371849764736:12345-192.168.206.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789448223.736296:0:22746:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7a3f413d-b754-460c-ba19-98579d387b28@192.168.206.38@tcp t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:3.0:1789448223.736328:0:22746:0:(genops.c:1384:class_connect()) connect: client 7a3f413d-b754-460c-ba19-98579d387b28, cookie 0x6522da1199ce4a6f 00000004:00100000:3.0:1789448223.736644:0:22746:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789448223.736693:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9517f23b8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789448223.736722:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:2388:x1876371849764736:12345-192.168.206.38@tcp:38:mount.lustre.0 Request processed in 442us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448223.736730:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 17 00000100:00100000:3.0:1789448223.744556:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.744715:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764992 00000100:00100000:0.0:1789448223.744725:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764992 00000100:00100000:0.0:1789448223.744805:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00100000:0.0:1789448223.744827:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849764992:12345-192.168.206.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789448223.744867:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789448223.744951:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849764992:12345-192.168.206.38@tcp:41:mount.lustre.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.744959:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00080000:3.0:1789448223.746787:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448223.749178:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.750739:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765120 00000100:00100000:0.0:1789448223.750752:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765120 00000100:00100000:0.0:1789448223.750843:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:0.0:1789448223.750854:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849765120:12345-192.168.206.38@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789448223.750955:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849765120:12345-192.168.206.38@tcp:40:mount.lustre.0 Request processed in 102us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.750976:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:1.0:1789448223.755099:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448223.755147:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448223.755238:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764864 00000100:00100000:2.0:1789448223.755248:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764864 00000100:00100000:2.0:1789448223.755322:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849764608 00000100:00100000:2.0:1789448223.755326:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849764608 00000100:00100000:2.0:1789448223.755374:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00100000:2.0:1789448223.755384:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:0:x1876371849764864:12345-192.168.206.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789448223.755416:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789448223.755519:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:0:x1876371849764864:12345-192.168.206.38@tcp:41:mount.lustre.0 Request processed in 127us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.755527:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00100000:2.0:1789448223.755545:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00100000:2.0:1789448223.755552:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f82c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:0:x1876371849764608:12345-192.168.206.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789448223.755564:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789448223.755590:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f82c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:0:x1876371849764608:12345-192.168.206.38@tcp:41:mount.lustre.0 Request processed in 39us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448223.755596:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00080000:3.0:1789448223.756346:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789448223.762124:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.762219:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448223.762300:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.764039:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765248 00000100:00100000:0.0:1789448223.764052:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765248 00000100:00100000:0.0:1789448223.764103:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765376 00000100:00100000:0.0:1789448223.764107:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765376 00000100:00100000:0.0:1789448223.764130:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00100000:0.0:1789448223.764138:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1876371849765248:12345-192.168.206.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789448223.764170:0:25219:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a3f413d-b754-460c-ba19-98579d387b28@192.168.206.38@tcp t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:0.0:1789448223.764201:0:25219:0:(genops.c:1384:class_connect()) connect: client 7a3f413d-b754-460c-ba19-98579d387b28, cookie 0x6522da1199ce4a76 00002000:00100000:0.0:1789448223.764213:0:25219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a3f413d-b754-460c-ba19-98579d387b28/ffff9517d1353800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789448223.764224:0:25219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1789448223.764291:0:25219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789448223.764329:0:25219:0:(import.c:65:import_set_state_nolock()) ffff9517d1350800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448223.764401:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a3f413d-b754-460c-ba19-98579d387b28+6:2388:x1876371849765248:12345-192.168.206.38@tcp:8:mount.lustre.0 Request processed in 263us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.764409:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00100000:0.0:1789448223.764427:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:0.0:1789448223.764432:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1876371849765376:12345-192.168.206.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789448223.764448:0:25219:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a3f413d-b754-460c-ba19-98579d387b28@192.168.206.38@tcp t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:0.0:1789448223.764493:0:25219:0:(genops.c:1384:class_connect()) connect: client 7a3f413d-b754-460c-ba19-98579d387b28, cookie 0x6522da1199ce4a7d 00002000:00100000:0.0:1789448223.764499:0:25219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a3f413d-b754-460c-ba19-98579d387b28/ffff9517d1354800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789448223.764504:0:25219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1789448223.764543:0:25219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789448223.764569:0:25219:0:(import.c:65:import_set_state_nolock()) ffff9517d1355000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789448223.764591:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a3f413d-b754-460c-ba19-98579d387b28+6:2388:x1876371849765376:12345-192.168.206.38@tcp:8:mount.lustre.0 Request processed in 157us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.764597:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:1.0:1789448223.769799:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765504 00000100:00100000:1.0:1789448223.769823:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765504 00000100:00100000:1.0:1789448223.769911:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 4 00000100:00100000:1.0:1789448223.769922:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849765504:12345-192.168.206.38@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789448223.770016:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849765504:12345-192.168.206.38@tcp:900:mount.lustre.0 Request processed in 95us (7901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448223.770024:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 4 00000100:00100000:3.0:1789448223.775286:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448223.775984:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765632 00000100:00100000:0.0:1789448223.775998:0:22748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765632 00000100:00100000:0.0:1789448223.776057:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 1 00000100:00100000:0.0:1789448223.776067:0:22748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849765632:12345-192.168.206.38@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789448223.776146:0:22748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789448223.776287:0:22748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:18229:x1876371849765632:12345-192.168.206.38@tcp:33:mount.lustre.0 Request processed in 221us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448223.776295:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 1 00000100:00100000:2.0:1789448224.066020:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448224.066185:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765760 00000100:00100000:3.0:1789448224.066194:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765760 00000100:00100000:3.0:1789448224.066252:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 22 00000100:00100000:3.0:1789448224.066262:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:18265:x1876371849765760:12345-192.168.206.38@tcp:101:mkdir.0 00010000:00010000:3.0:1789448224.066280:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448224.066303:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90efe00/0x6522da1199ce4a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87212 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448224.066374:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448224.066387:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448224.066414:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448224.066487:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789448224.066492:0:22745:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789448224.066522:0:22745:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448224.066548:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90efe00/0x6522da1199ce4a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 8 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448224.066567:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448224.066575:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:3.0:1789448224.066578:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448224.066582:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517d90ef000, rc 0) 00000100:00100000:3.0:1789448224.066644:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+7:18265:x1876371849765760:12345-192.168.206.38@tcp:101:mkdir.0 Request processed in 383us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448224.066652:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 22 00010000:00010000:2.0:1789448224.373697:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789448225.402701:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448226.423662:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789448226.489046:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a3f413d-b754-460c-ba19-98579d387b28 00000001:00100000:2.0:1789448226.489059:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fe0e289e-d7a2-4039-8365-2f54416a41ea 00000001:00100000:0.0:1789448226.490435:0:25065:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a3f413d-b754-460c-ba19-98579d387b28 00000001:00100000:0.0:1789448226.490445:0:25065:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fe0e289e-d7a2-4039-8365-2f54416a41ea 00000001:00100000:1.0:1789448226.490512:0:23476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7a3f413d-b754-460c-ba19-98579d387b28 00000001:00100000:1.0:1789448226.490518:0:23476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fe0e289e-d7a2-4039-8365-2f54416a41ea 00000100:00100000:1.0:1789448227.002181:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859303552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789448227.002293:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448227.003128:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303552 00000100:00100000:0.0:1789448227.003141:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303552 00000100:00100000:0.0:1789448227.003230:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448227.003242:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859303552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789448227.003282:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789448227.003360:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859303552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448227.003369:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789448227.003553:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859303552:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789448227.003553:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789448227.008020:0:22725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a3f413d-b754-460c-ba19-98579d387b28 00000001:00100000:2.0:1789448227.008032:0:22725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fe0e289e-d7a2-4039-8365-2f54416a41ea 00000001:02000400:0.0:1789448227.434914:0:25623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789448227.448371:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448228.021940:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859303680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448228.022008:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448228.022434:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303680 00000100:00100000:1.0:1789448228.022443:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303680 00000100:00100000:1.0:1789448228.022533:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789448228.022544:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859303680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789448228.022589:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789448228.022639:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876371859303680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448228.022663:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448228.023348:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3635:1876371859303680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789448228.023475:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789448228.023487:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859303808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448228.023545:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.023981:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303808 00000100:00100000:0.0:1789448228.023989:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303808 00000100:00100000:0.0:1789448228.024027:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789448228.024036:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859303808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789448228.024159:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789448228.024219:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859303808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.024227:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789448228.024396:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859303808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789448228.469867:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448228.533728:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859304064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448228.533776:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859303936:0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.533795:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.533820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.534010:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859304576:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.534045:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.534073:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859305088:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.534095:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.534119:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789448228.534125:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859304192:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.534154:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.534174:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859304704:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.534198:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.534215:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859305216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.534238:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.534394:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859303936 00000100:00100000:0.0:1789448228.534401:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859303936 00000100:00100000:0.0:1789448228.534444:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789448228.534453:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3634:x1876371859303936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.534538:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3634:x1876371859303936:12345-0@lo:400:kworker.0 Request processed in 86us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.534545:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789448228.534576:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304576 00000100:00100000:0.0:1789448228.534586:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304576 00000100:00100000:0.0:1789448228.549025:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859305600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789448228.549163:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859305088 00000100:00100000:0.0:1789448228.549171:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859305088 00000100:00100000:2.0:1789448228.554240:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859305216 00000100:00100000:2.0:1789448228.554253:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859305216 00000100:00100000:2.0:1789448228.554302:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789448228.554313:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859304576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448228.554413:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859304576:12345-0@lo:400:kworker.0 Request processed in 103us (20367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.554420:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789448228.554436:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789448228.554443:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859305088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448228.554502:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859305088:12345-0@lo:400:kworker.0 Request processed in 46us (20392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.554508:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789448228.555209:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448228.555221:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859305216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448228.555266:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859305216:12345-0@lo:400:kworker.0 Request processed in 48us (21026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.555272:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789448228.555301:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304192 00000100:00100000:2.0:1789448228.555306:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304192 00000100:00100000:2.0:1789448228.555335:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304704 00000100:00100000:2.0:1789448228.555338:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304704 00000100:00100000:2.0:1789448228.555355:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448228.555360:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859304192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448228.555389:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859304192:12345-0@lo:400:kworker.0 Request processed in 29us (21235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.555395:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789448228.555404:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789448228.555409:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859304704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789448228.555433:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859304704:12345-0@lo:400:kworker.0 Request processed in 25us (21236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.555439:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789448228.567156:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fb9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859304320:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789448228.567247:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789448228.567253:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789448228.567255:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448228.575277:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859304448:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.577959:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448228.578014:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448228.578079:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859304960:0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.578129:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448228.578158:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859305472:0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.578183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448228.578221:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304448 00000100:00100000:1.0:1789448228.578229:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304448 00000100:00100000:1.0:1789448228.578277:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789448228.578286:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.579498:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859304448:12345-0@lo:400:kworker.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448228.579509:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789448228.579539:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448228.579570:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859304448:0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.579597:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304960 00000100:00100000:1.0:1789448228.579602:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304960 00000100:00100000:1.0:1789448228.579637:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859305472 00000100:00100000:1.0:1789448228.579640:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859305472 00000100:00100000:1.0:1789448228.579667:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789448228.579674:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859304960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.579724:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859304960:12345-0@lo:400:kworker.0 Request processed in 50us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448228.579742:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789448228.579755:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789448228.579762:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448228.579791:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859305472:12345-0@lo:400:kworker.0 Request processed in 30us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448228.579796:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789448228.579882:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789448228.579905:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859304960:0@lo:400:kworker.0 00010000:00080000:1.0:1789448228.579917:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c6410000 x1876371859305472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448228.579928:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859305472:0@lo:400:kworker.0 00000100:00100000:2.0:1789448228.580036:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304064 00000100:00100000:2.0:1789448228.580041:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304064 00000100:00100000:2.0:1789448228.580170:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789448228.580177:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859304064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448228.580205:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448228.580242:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859304064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (46448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.580248:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789448228.581053:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517e7411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859304064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789448228.586189:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859304832:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586243:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.586268:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859305344:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586291:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.586334:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304320 00000100:00100000:0.0:1789448228.586352:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304320 00000100:00100000:0.0:1789448228.586400:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448228.586409:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859304320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448228.586449:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789448228.586521:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859304320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (8567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.586528:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448228.586550:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448228.586584:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859304192:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586597:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859304704:0@lo:400:kworker.0 00010000:00080000:0.0:1789448228.586608:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c6412a00 x1876371859305216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448228.586629:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859305216:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586642:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859303936:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586654:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859304576:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586664:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859305088:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586693:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859304832 00000100:00100000:0.0:1789448228.586696:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859304832 00000100:00100000:0.0:1789448228.586728:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448228.586735:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859304832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586766:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859304832:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.586771:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789448228.586787:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859305344 00000100:00100000:0.0:1789448228.586791:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859305344 00000100:00100000:0.0:1789448228.586834:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789448228.586842:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859305344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.586871:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1876371859305344:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.586876:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789448228.586891:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859305600 00000100:00100000:0.0:1789448228.586895:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859305600 00000100:00100000:0.0:1789448228.586908:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789448228.586913:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859305600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789448228.586922:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789448228.587457:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859305600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 541us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.587497:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789448228.587514:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448228.587518:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448228.587552:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fb9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859304320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789448228.587563:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859304832:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.587572:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3632:1876371859305344:0@lo:400:kworker.0 00000100:00100000:0.0:1789448228.587601:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859305600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789448228.922598:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922634:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922666:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448228.922674:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766272 00000100:00100000:3.0:1789448228.922688:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766272 00000100:00100000:0.0:1789448228.922696:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922725:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922743:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922763:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922779:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922805:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448228.922829:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766016 00000100:00100000:0.0:1789448228.922834:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766016 00000100:00100000:0.0:1789448228.922869:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766528 00000100:00100000:0.0:1789448228.922873:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766528 00000100:00100000:0.0:1789448228.922886:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766144 00000100:00100000:0.0:1789448228.922889:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766144 00000100:00100000:0.0:1789448228.922904:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766656 00000100:00100000:0.0:1789448228.922906:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766656 00000100:00100000:0.0:1789448228.922923:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 50 00000100:00100000:0.0:1789448228.922934:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2390:x1876371849766016:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:3.0:1789448228.923017:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766784 00000100:00100000:3.0:1789448228.923022:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766784 00000100:00100000:0.0:1789448228.923034:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2390:x1876371849766016:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 100us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448228.923042:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766400 00000100:00100000:0.0:1789448228.923050:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 50 00000100:00100000:0.0:1789448228.923072:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 51 00000100:00100000:0.0:1789448228.923079:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a3f413d-b754-460c-ba19-98579d387b28+6:2390:x1876371849766528:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448228.923103:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a3f413d-b754-460c-ba19-98579d387b28+6:2390:x1876371849766528:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.923110:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 51 00000100:00100000:0.0:1789448228.923121:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 52 00000100:00100000:0.0:1789448228.923127:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2390:x1876371849766144:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448228.923151:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2390:x1876371849766144:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.923157:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 52 00000100:00100000:0.0:1789448228.923169:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 53 00000100:00100000:0.0:1789448228.923175:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a3f413d-b754-460c-ba19-98579d387b28+5:2390:x1876371849766656:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448228.923197:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a3f413d-b754-460c-ba19-98579d387b28+5:2390:x1876371849766656:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.923204:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 53 00000100:00100000:0.0:1789448228.923227:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849766912 00000100:00100000:0.0:1789448228.923231:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766912 00000100:00100000:3.0:1789448228.923242:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849766400 00000100:00100000:0.0:1789448228.923255:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:0.0:1789448228.923266:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2390:x1876371849766272:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448228.923295:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2390:x1876371849766272:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448228.923332:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 11 00000100:00100000:3.0:1789448228.923344:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a3f413d-b754-460c-ba19-98579d387b28+5:2390:x1876371849766784:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:3.0:1789448228.923376:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a3f413d-b754-460c-ba19-98579d387b28+5:2390:x1876371849766784:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 36us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.923450:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849765888 00000100:00100000:2.0:1789448228.923455:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849765888 00000100:00100000:2.0:1789448228.923510:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 146 00000100:00100000:2.0:1789448228.923518:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:2390:x1876371849765888:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:2.0:1789448228.923547:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:2390:x1876371849765888:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 30us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448228.923554:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 146 00000100:00100000:0.0:1789448228.924072:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:0.0:1789448228.924094:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 12 00000100:00100000:0.0:1789448228.924104:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a3f413d-b754-460c-ba19-98579d387b28+5:2390:x1876371849766912:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448228.924138:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a3f413d-b754-460c-ba19-98579d387b28+5:2390:x1876371849766912:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 37us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.924145:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 12 00000100:00100000:0.0:1789448228.924168:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 13 00000100:00100000:0.0:1789448228.924175:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2390:x1876371849766400:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448228.924195:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2390:x1876371849766400:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 21us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448228.924859:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 13 00000100:00100000:3.0:1789448228.925477:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 11 00000100:00080000:3.0:1789448228.925518:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789448228.925581:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789448228.925585:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789448228.925588:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789448229.498183:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448230.518109:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789448230.902157:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789448231.546092:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789448231.835592:0:25770:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeec4ae7a0 20000000:00000080:0.0:1789448231.835610:0:25770:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9517d1370000 uarg=0000000000000000 20000000:01000000:0.0:1789448231.835659:0:25770:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789448231.835665:0:25770:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789448231.835669:0:25770:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789448231.846382:0:25771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789448231.846842:0:25770:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789448231.857336:0:25770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789448231.857637:0:25770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857661:0:25770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 23 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857669:0:25770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 23 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857694:0:25770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4735 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857700:0:25770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce47cf expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857711:0:25770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857717:0:25770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857724:0:25770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857762:0:25770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857777:0:25770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 12 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.857803:0:25770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859305728:192.168.206.38@tcp:104: 00010000:00010000:0.0:1789448231.857905:0:25770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857915:0:25770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.857923:0:25770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859305856:192.168.206.38@tcp:104: 00010000:00010000:0.0:1789448231.857965:0:25770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce47cf expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.857973:0:25770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce47cf expref: 23 pid: 22738 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.857982:0:25770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859305984:0@lo:104: 00000100:00100000:0.0:1789448231.858020:0:25770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448231.858059:0:25770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce4735 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.858066:0:25770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce4735 expref: 23 pid: 22740 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.858074:0:25770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859306112:0@lo:104: 00000100:00100000:0.0:1789448231.858095:0:25770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448231.858118:0:25770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 23 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.858126:0:25770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 23 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.858134:0:25770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859306240:0@lo:104: 00000100:00100000:0.0:1789448231.858154:0:25770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789448231.858183:0:25770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 23 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448231.858191:0:25770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 23 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.858209:0:25770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859306368:0@lo:104: 00000100:00100000:0.0:1789448231.858231:0:25770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448231.858241:0:25770:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f9378c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448231.858744:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859305984 00000100:00100000:3.0:1789448231.858754:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859305984 00000100:00100000:3.0:1789448231.858813:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306112 00000100:00100000:3.0:1789448231.858817:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306112 00000100:00100000:3.0:1789448231.858828:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306240 00000100:00100000:3.0:1789448231.858831:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306240 00000100:00100000:3.0:1789448231.858839:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306368 00000100:00100000:3.0:1789448231.858841:0:22729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306368 00000100:00100000:3.0:1789448231.858854:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448231.858862:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fb9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+6:25770:x1876371859305984:12345-0@lo:104: 00010000:00010000:3.0:1789448231.858875:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.858932:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789448231.858938:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fb9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+6:25770:x1876371859305984:12345-0@lo:104: Request processed in 78us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448231.858955:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789448231.858975:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448231.858980:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+5:25770:x1876371859306112:12345-0@lo:104: 00010000:00010000:3.0:1789448231.858988:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859024:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789448231.859029:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+5:25770:x1876371859306112:12345-0@lo:104: Request processed in 50us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448231.859035:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789448231.859049:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448231.859055:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:25770:x1876371859306240:12345-0@lo:104: 00010000:00010000:3.0:1789448231.859063:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859092:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789448231.859097:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+4:25770:x1876371859306240:12345-0@lo:104: Request processed in 43us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448231.859102:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789448231.859114:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789448231.859119:0:22729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:25770:x1876371859306368:12345-0@lo:104: 00010000:00010000:3.0:1789448231.859127:0:22729:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859151:0:22729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789448231.859156:0:22729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+3:25770:x1876371859306368:12345-0@lo:104: Request processed in 38us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448231.859168:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789448231.859197:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789448231.859204:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859212:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8d600 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448231.859216:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859224:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448231.859232:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448231.859237:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448231.859264:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859271:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448231.859295:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859301:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d600/0x6522da1199ce47cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce47d6 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859314:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789448231.859317:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859333:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517d477a600 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448231.859336:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859342:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448231.859348:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448231.859352:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448231.859365:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859371:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448231.859384:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859390:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517d477a600/0x6522da1199ce4735 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce473c expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859399:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789448231.859402:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859407:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd75fa00 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448231.859409:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859425:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448231.859432:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448231.859437:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448231.859450:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859455:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448231.859501:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859508:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9517fd75fa00/0x6522da1199ce46f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46fd expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859518:0:22733:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789448231.859521:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859527:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b8d000 already unused, calling callback (ffffffffc127bc20) 10000000:00010000:3.0:1789448231.859530:0:22733:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859536:0:22733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789448231.859541:0:22733:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448231.859553:0:22733:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789448231.859568:0:22733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859574:0:22733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789448231.859581:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859588:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.138@tcp lock: ffff9516c7b8d000/0x6522da1199ce46e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6522da1199ce46ef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448231.859599:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448231.859601:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789448231.859603:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789448231.859616:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859306496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448231.859650:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448231.859680:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789448231.859685:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859306880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448231.859704:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448231.859727:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859306624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448231.859747:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448231.859760:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448231.859765:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517fd9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859306752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448231.859795:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789448231.859875:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448231.859890:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306496 00000100:00100000:1.0:1789448231.859895:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306496 00010000:00010000:1.0:1789448231.859917:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce47cf expref: 24 pid: 22738 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448231.859932:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306880 00000100:00100000:1.0:1789448231.859935:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306880 00010000:00010000:1.0:1789448231.859945:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 25 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448231.859954:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306624 00000100:00100000:1.0:1789448231.859963:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306624 00010000:00010000:1.0:1789448231.859976:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4735 expref: 26 pid: 22740 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448231.859987:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859306752 00000100:00100000:1.0:1789448231.859989:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859306752 00010000:00010000:1.0:1789448231.859997:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 27 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448231.860009:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789448231.860016:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+27:3635:x1876371859306496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448231.860026:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448231.860031:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce47cf expref: 27 pid: 22738 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860040:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce47cf expref: 27 pid: 22738 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860055:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448231.860096:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+27:3635:x1876371859306496:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448231.860102:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789448231.860117:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448231.860123:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+26:3635:x1876371859306880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448231.860131:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448231.860135:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 26 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860143:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 26 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860163:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448231.860186:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+26:3635:x1876371859306880:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448231.860193:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789448231.860205:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448231.860211:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c770dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+25:3632:x1876371859306624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448231.860220:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448231.860224:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce4735 expref: 25 pid: 22740 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860231:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce4735 expref: 25 pid: 22740 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860239:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448231.860269:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c770dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+25:3632:x1876371859306624:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448231.860274:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789448231.860286:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789448231.860291:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3632:x1876371859306752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789448231.860297:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448231.860301:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 24 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860308:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 24 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.860316:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448231.860342:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3632:x1876371859306752:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448231.860348:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789448231.860383:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859306752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789448231.860391:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:562d8d7b-adf5-44cc-8730-f8665ac1447a:3632:1876371859306624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448231.860778:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859306880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789448231.861015:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517fd9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:562d8d7b-adf5-44cc-8730-f8665ac1447a:3635:1876371859306496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789448231.861281:0:25770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477bc00/0x6522da1199ce47d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce47cf expref: 23 pid: 22738 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.861294:0:25770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859305984:0@lo:104: 00010000:00010000:0.0:1789448231.861307:0:25770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9516c7b8c400/0x6522da1199ce473c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce4735 expref: 22 pid: 22740 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.861315:0:25770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859306112:0@lo:104: 00010000:00010000:0.0:1789448231.861325:0:25770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477b800/0x6522da1199ce46fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce46f6 expref: 21 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.861332:0:25770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859306240:0@lo:104: 00010000:00010000:0.0:1789448231.861341:0:25770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9517d477ba00/0x6522da1199ce46ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6522da1199ce46e8 expref: 20 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448231.861348:0:25770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859306368:0@lo:104: 00010000:00010000:2.0:1789448231.864324:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448231.873743:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448231.873869:0:25770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859305728:192.168.206.38@tcp:104: 00000100:00100000:2.0:1789448231.873881:0:25770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25770:1876371859305856:192.168.206.38@tcp:104: 00010000:00010000:2.0:1789448231.873933:0:25770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448231.874188:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767040 00000100:00100000:1.0:1789448231.874196:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767040 00010000:00010000:1.0:1789448231.874231:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 13 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448231.874271:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 13 00000100:00100000:1.0:1789448231.874280:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:2391:x1876371849767040:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448231.874294:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448231.874300:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 13 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.874310:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 13 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.874326:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95180207aa00/0x6522da1199ce4a61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb871e1 expref: 13 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448231.874340:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448231.874447:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:2391:x1876371849767040:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 167us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448231.874455:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 13 00000100:00100000:1.0:1789448231.877258:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448231.877505:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767168 00000100:00100000:2.0:1789448231.877515:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767168 00010000:00010000:2.0:1789448231.877551:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448231.877597:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 14 00000100:00100000:2.0:1789448231.877607:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:2392:x1876371849767168:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448231.877621:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448231.877627:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877639:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877668:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95180207be00/0x6522da1199ce4a22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87171 expref: 12 pid: 22739 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877687:0:22730:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877696:0:22730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877712:0:22730:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877731:0:22730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877738:0:22730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877744:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877750:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95180207b600 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:2.0:1789448231.877754:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877763:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.877778:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.878014:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448231.878061:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:2392:x1876371849767168:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 454us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448231.878069:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 14 00010000:00010000:2.0:1789448231.878098:0:25770:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.878106:0:25770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448231.878112:0:25770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95180207b600/0x6522da1199ce4a92 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448232.118020:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448232.118042:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859307008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789448232.118109:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448232.118158:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307008 00000100:00100000:2.0:1789448232.118164:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307008 00000100:00100000:2.0:1789448232.118217:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789448232.118226:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859307008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789448232.118252:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448232.118294:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859307008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448232.118301:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789448232.118320:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789448232.118354:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859307008:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789448232.568175:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789448233.141890:0:22742:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448233.141898:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9516c7a84000 from 13 10000000:01000000:3.0:1789448233.141903:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448233.141952:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.141963:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.141975:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448233.142001:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c833a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.142069:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448233.142135:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d81dae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789448233.142414:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448233.142441:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859307264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789448233.142513:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448233.142547:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307264 00000100:00100000:1.0:1789448233.142554:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307264 00000100:00100000:1.0:1789448233.142591:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789448233.142598:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859307264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789448233.142628:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789448233.142671:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859307264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448233.142677:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789448233.142724:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859307264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448233.142928:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307136 00000100:00100000:2.0:1789448233.142939:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307136 00000100:00100000:2.0:1789448233.142977:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789448233.142984:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+20:22742:x1876371859307136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448233.142994:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448233.143009:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9517fd7e9600/0x6522da1199ce4aa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4a99 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.143029:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9517fd7e9600/0x6522da1199ce4aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4a99 expref: 21 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.143041:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9517fd7e9600/0x6522da1199ce4aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4a99 expref: 21 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.143050:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9600, rc 0) 00000100:00100000:2.0:1789448233.143083:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859307136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448233.143089:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789448233.143139:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c833a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789448233.143153:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aa0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.143162:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4aa0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448233.143212:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789448233.143236:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448233.143254:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517da7fb000 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.143417:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307520 00000100:00100000:0.0:1789448233.143422:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307520 00000100:00100000:0.0:1789448233.143450:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789448233.143456:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859307520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.143581:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859307520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.143597:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789448233.143624:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.143648:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.143682:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.143698:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f9378c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.143708:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307648 00000100:00100000:0.0:1789448233.143711:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307648 00000100:00100000:0.0:1789448233.143738:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789448233.143743:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e70e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859307648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.143806:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e70e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859307648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.143812:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789448233.143844:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.144765:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789448233.144780:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859307392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789448233.144818:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448233.145679:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307392 00000100:00100000:1.0:1789448233.145689:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307392 00000100:00100000:1.0:1789448233.145749:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789448233.145757:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859307392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789448233.145785:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789448233.145847:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1876371859307392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448233.145853:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789448233.145896:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3632:1876371859307392:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789448233.146366:0:25784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789448233.147254:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789448233.147280:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789448233.147291:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aa0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448233.147302:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c8009600/0x6522da1199ce4a99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aa0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789448233.147326:0:22742:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789448233.147329:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517e1570000 from 13 10000000:01000000:1.0:1789448233.147331:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789448233.147362:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448233.147370:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448233.147380:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448233.147404:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789448233.147507:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448233.147542:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c88ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.147918:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307776 00000100:00100000:0.0:1789448233.147925:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307776 00000100:00100000:0.0:1789448233.147976:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789448233.147984:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+21:22742:x1876371859307776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448233.147996:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448233.148009:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207a200/0x6522da1199ce4aae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4aa7 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.148032:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207a200/0x6522da1199ce4aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4aa7 expref: 22 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.148058:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207a200/0x6522da1199ce4aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4aa7 expref: 22 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.148066:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207a200, rc 0) 00000100:00100000:0.0:1789448233.148132:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859307776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.148140:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789448233.149453:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789448233.149505:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aae expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448233.149517:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4aae expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448233.149591:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448233.149635:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448233.149673:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c88ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.150699:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859307904 00000100:00100000:0.0:1789448233.150708:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859307904 00000100:00100000:0.0:1789448233.150773:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789448233.150782:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859307904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.150939:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859307904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.150947:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789448233.151042:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859307904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.151084:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c8339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.151147:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448233.151183:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d81da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.152047:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308032 00000100:00100000:0.0:1789448233.152055:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308032 00000100:00100000:0.0:1789448233.152122:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789448233.152130:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859308032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.152242:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859308032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.152249:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789448233.152573:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c8339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789448233.154025:0:25785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789448233.154305:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789448233.154328:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789448233.154340:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aae expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.154361:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9517c0031000/0x6522da1199ce4aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aae expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789448233.154373:0:22742:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789448233.154376:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517d3af2000 from 13 10000000:01000000:3.0:1789448233.154379:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789448233.154414:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.154422:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.154432:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448233.154491:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c8339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.154552:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448233.154589:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d81da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.154843:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308160 00000100:00100000:0.0:1789448233.154851:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308160 00000100:00100000:0.0:1789448233.154900:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789448233.154911:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c809cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+22:22742:x1876371859308160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448233.154933:0:22738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448233.154946:0:22738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207b600/0x6522da1199ce4abc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4ab5 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.154969:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207b600/0x6522da1199ce4abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4ab5 expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.154979:0:22738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207b600/0x6522da1199ce4abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4ab5 expref: 23 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.154987:0:22738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207b600, rc 0) 00000100:00100000:0.0:1789448233.155027:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c809cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859308160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.155034:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789448233.155706:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c8339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448233.155731:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4abc expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.155742:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4abc expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448233.155810:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c8339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.155844:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448233.155892:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d81da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.156729:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308288 00000100:00100000:0.0:1789448233.156739:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308288 00000100:00100000:0.0:1789448233.156782:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789448233.156791:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859308288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.156919:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859308288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.156927:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789448233.157044:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c8339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789448233.157108:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789448233.157161:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448233.157193:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.157298:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308416 00000100:00100000:0.0:1789448233.157302:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308416 00000100:00100000:0.0:1789448233.157332:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789448233.157338:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859308416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.157403:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859308416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.157417:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789448233.157518:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789448233.162063:0:25786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789448233.169340:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789448233.169382:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789448233.169395:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4abc expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.169406:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff9516c8008400/0x6522da1199ce4ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4abc expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789448233.169418:0:22742:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789448233.169420:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9517fb910000 from 13 10000000:01000000:0.0:1789448233.169423:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789448233.169498:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.169506:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.169517:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448233.169540:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.169601:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.169646:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f9378c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448233.169900:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308544 00000100:00100000:3.0:1789448233.169908:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308544 00000100:00100000:3.0:1789448233.169960:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789448233.169970:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+23:22742:x1876371859308544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448233.169982:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448233.169995:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c8009c00/0x6522da1199ce4aca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6522da1199ce4ac3 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.170018:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c8009c00/0x6522da1199ce4aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6522da1199ce4ac3 expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.170029:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c8009c00/0x6522da1199ce4aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6522da1199ce4ac3 expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.170036:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8009c00, rc 0) 00000100:00100000:3.0:1789448233.170085:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859308544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448233.170100:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789448233.170319:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448233.170333:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aca expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.170342:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6522da1199ce4aca expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448233.170413:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.170441:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.170516:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f9378c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789448233.170658:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308672 00000100:00100000:3.0:1789448233.170663:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308672 00000100:00100000:3.0:1789448233.170698:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789448233.170707:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859308672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.170882:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859308672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448233.170890:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789448233.173871:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.177906:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c8338380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.177995:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789448233.178059:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d81da840 going to sleep for 11 seconds 00000100:00100000:0.0:1789448233.178234:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308800 00000100:00100000:0.0:1789448233.178242:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308800 00000100:00100000:0.0:1789448233.178288:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789448233.178296:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859308800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.178402:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:22742:x1876371859308800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.178409:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789448233.178508:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c8338380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:562d8d7b-adf5-44cc-8730-f8665ac1447a:22742:1876371859308800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789448233.179600:0:25787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789448233.179809:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789448233.179829:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789448233.179840:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aca expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.179851:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.138@tcp lock: ffff95180207be00/0x6522da1199ce4ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6522da1199ce4aca expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789448233.336283:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789448233.342757:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448233.342876:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767296 00000100:00100000:3.0:1789448233.342885:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767296 00000100:00100000:3.0:1789448233.342936:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 159 00000100:00100000:3.0:1789448233.342945:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+11:18114:x1876371849767296:12345-192.168.206.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789448233.342962:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448233.342981:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9516c8008000/0x6522da1199ce4ad1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb87219 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.343008:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9516c8008000/0x6522da1199ce4ad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87219 expref: 12 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.343019:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9516c8008000/0x6522da1199ce4ad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87219 expref: 12 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448233.343028:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8008000, rc 0) 00000100:00100000:3.0:1789448233.343080:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18114:x1876371849767296:12345-192.168.206.38@tcp:101:ll_cfg_requeue.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448233.343087:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 159 00000100:00100000:1.0:1789448233.349400:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448233.349500:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767424 00000100:00100000:3.0:1789448233.349520:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767424 00000100:00100000:3.0:1789448233.349579:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 160 00000100:00100000:3.0:1789448233.349589:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18114:x1876371849767424:12345-192.168.206.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.349740:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18114:x1876371849767424:12345-192.168.206.38@tcp:501:ll_cfg_requeue.0 Request processed in 151us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448233.349748:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 160 00000100:00100000:1.0:1789448233.354174:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448233.355001:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767552 00000100:00100000:3.0:1789448233.355024:0:22740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767552 00000100:00100000:3.0:1789448233.355083:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 161 00000100:00100000:3.0:1789448233.355105:0:22740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18114:x1876371849767552:12345-192.168.206.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789448233.355241:0:22740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18114:x1876371849767552:12345-192.168.206.38@tcp:503:ll_cfg_requeue.0 Request processed in 148us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448233.355249:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 161 00000100:00100000:1.0:1789448233.364249:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448233.364347:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767680 00000100:00100000:0.0:1789448233.364358:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767680 00000100:00100000:0.0:1789448233.364408:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 162 00000100:00100000:0.0:1789448233.364418:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+12:18114:x1876371849767680:12345-192.168.206.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789448233.364433:0:22739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448233.364451:0:22739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95180207aa00/0x6522da1199ce4ad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x239082f3feb87220 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.364534:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95180207aa00/0x6522da1199ce4ad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87220 expref: 13 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.364545:0:22739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95180207aa00/0x6522da1199ce4ad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87220 expref: 13 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.364554:0:22739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95180207aa00, rc 0) 00000100:00100000:0.0:1789448233.364627:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18114:x1876371849767680:12345-192.168.206.38@tcp:101:ll_cfg_requeue.0 Request processed in 210us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.364633:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 162 00000100:00100000:1.0:1789448233.370097:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448233.370197:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767808 00000100:00100000:0.0:1789448233.370208:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767808 00000100:00100000:0.0:1789448233.370353:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 163 00000100:00100000:0.0:1789448233.370365:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18114:x1876371849767808:12345-192.168.206.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.370560:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18114:x1876371849767808:12345-192.168.206.38@tcp:501:ll_cfg_requeue.0 Request processed in 197us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.370568:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 163 00000100:00100000:1.0:1789448233.373530:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448233.373592:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849767936 00000100:00100000:0.0:1789448233.373601:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849767936 00000100:00100000:0.0:1789448233.373707:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 164 00000100:00100000:0.0:1789448233.373853:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18114:x1876371849767936:12345-192.168.206.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789448233.374036:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:18114:x1876371849767936:12345-192.168.206.38@tcp:503:ll_cfg_requeue.0 Request processed in 320us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.374046:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 164 00010000:00010000:1.0:1789448233.590902:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448233.653813:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859308928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.653878:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.653908:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859309440:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.653926:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.653939:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3634:1876371859309952:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.653956:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.653975:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789448233.653979:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859309056:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654011:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654028:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859309568:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654047:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654062:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859310080:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654096:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654128:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859309184:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654151:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654169:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859309696:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654189:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654200:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789448233.654205:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859309312:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654241:0:3632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c640ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859309824:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654260:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448233.654353:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859308928 00000100:00100000:0.0:1789448233.654359:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859308928 00000100:00100000:0.0:1789448233.654399:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309440 00000100:00100000:0.0:1789448233.654401:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309440 00000100:00100000:0.0:1789448233.654413:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309056 00000100:00100000:0.0:1789448233.654415:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309056 00000100:00100000:0.0:1789448233.654424:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309312 00000100:00100000:0.0:1789448233.654426:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309312 00000100:00100000:0.0:1789448233.654437:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789448233.654443:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859308928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654530:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859308928:12345-0@lo:400:kworker.0 Request processed in 86us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654536:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789448233.654558:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448233.654563:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859309440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654587:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1876371859309440:12345-0@lo:400:kworker.0 Request processed in 24us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654592:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789448233.654600:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789448233.654605:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859309056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654623:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859309056:12345-0@lo:400:kworker.0 Request processed in 19us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654628:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789448233.654635:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448233.654640:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859309312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654662:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1876371859309312:12345-0@lo:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654668:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789448233.654685:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309952 00000100:00100000:0.0:1789448233.654688:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309952 00000100:00100000:0.0:1789448233.654705:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309568 00000100:00100000:0.0:1789448233.654707:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309568 00000100:00100000:0.0:1789448233.654715:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859310080 00000100:00100000:0.0:1789448233.654717:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859310080 00000100:00100000:0.0:1789448233.654725:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309184 00000100:00100000:0.0:1789448233.654727:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309184 00000100:00100000:0.0:1789448233.654734:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309696 00000100:00100000:0.0:1789448233.654736:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309696 00000100:00100000:0.0:1789448233.654744:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859309824 00000100:00100000:0.0:1789448233.654746:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859309824 00000100:00100000:0.0:1789448233.654756:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789448233.654761:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1876371859309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654794:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1876371859309952:12345-0@lo:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654800:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789448233.654811:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789448233.654816:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859309568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654835:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876371859309568:12345-0@lo:400:kworker.0 Request processed in 20us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654840:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789448233.654848:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789448233.654852:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876371859310080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654869:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876371859310080:12345-0@lo:400:kworker.0 Request processed in 17us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654875:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789448233.654882:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448233.654887:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859309184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654917:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1876371859309184:12345-0@lo:400:kworker.0 Request processed in 30us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654923:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789448233.654932:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448233.654937:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859309696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654955:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1876371859309696:12345-0@lo:400:kworker.0 Request processed in 18us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.654959:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789448233.654967:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789448233.654972:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859309824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.654996:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1876371859309824:12345-0@lo:400:kworker.0 Request processed in 25us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.655002:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789448233.655031:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789448233.655035:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789448233.655038:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789448233.655040:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789448233.655144:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3632:1876371859309312:0@lo:400:kworker.0 00010000:00080000:0.0:1789448233.655157:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c640ad80 x1876371859309824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448233.655166:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3632:1876371859309824:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655174:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3632:1876371859309184:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655181:0:3632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3632:1876371859309696:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655211:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859309056:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655219:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876371859309568:0@lo:400:kworker.0 00010000:00080000:0.0:1789448233.655228:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c6409180 x1876371859310080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789448233.655236:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3634:1876371859310080:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655245:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859308928:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655254:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3634:1876371859309440:0@lo:400:kworker.0 00000100:00100000:0.0:1789448233.655262:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c640bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3634:1876371859309952:0@lo:400:kworker.0 00000100:00100000:2.0:1789448233.655432:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448233.655443:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859310208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789448233.655508:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448233.655537:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859310208 00000100:00100000:2.0:1789448233.655541:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859310208 00000100:00100000:2.0:1789448233.655569:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448233.655575:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859310208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789448233.655594:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789448233.655624:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859310208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448233.655630:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789448233.655656:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859310208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789448233.656058:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789448233.656067:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448233.656095:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448233.656119:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859310336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789448233.656139:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448233.656173:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859310464 00000100:00100000:2.0:1789448233.656177:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859310464 00000100:00100000:2.0:1789448233.656190:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859310336 00000100:00100000:2.0:1789448233.656192:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859310336 00000100:00100000:2.0:1789448233.656202:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448233.656207:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859310464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448233.656217:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448233.656246:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859310464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448233.656250:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789448233.656272:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448233.656278:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859310336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789448233.656286:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789448233.656309:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1876371859310336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448233.656314:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448233.656336:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448233.656354:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859310336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448233.868333:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448233.868441:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768064 00000100:00100000:0.0:1789448233.868506:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768064 00000100:00100000:0.0:1789448233.868574:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:0.0:1789448233.868584:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:18734:x1876371849768064:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448233.868601:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448233.868619:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95180207ba00/0x6522da1199ce4adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87227 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868674:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868687:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868700:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868714:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868720:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868727:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868801:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f600/0x6522da1199ce4af4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868809:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f600/0x6522da1199ce4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868816:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f600/0x6522da1199ce4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448233.868852:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789448233.868856:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789448233.868890:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f600/0x6522da1199ce4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868901:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868908:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868915:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868921:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2f800 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:0.0:1789448233.868925:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868932:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868943:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:0.0:1789448233.868946:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448233.868952:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868957:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868969:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868985:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868991:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.868996:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2fa00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:0.0:1789448233.869000:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.869006:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.869014:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9517c2848b00) 00010000:00010000:0.0:1789448233.869016:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448233.869019:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.869024:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4aed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.869056:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95180207ba00/0x6522da1199ce4adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87227 expref: 8 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.869069:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f600/0x6522da1199ce4af4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87227 expref: 7 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.869076:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9517c2848600) 00010000:00010000:0.0:1789448233.869078:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448233.869086:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2f600, rc 0) 00000100:00100000:0.0:1789448233.869146:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18734:x1876371849768064:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 563us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.869154:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00080000:2.0:1789448233.870040:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448233.871779:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448233.871865:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768192 00000100:00100000:3.0:1789448233.871874:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768192 00000100:00100000:3.0:1789448233.871924:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 5 00000100:00100000:3.0:1789448233.871934:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18734:x1876371849768192:12345-192.168.206.38@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789448233.872008:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18734:x1876371849768192:12345-192.168.206.38@tcp:900:lhsmtool_posix.0 Request processed in 75us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448233.872015:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 5 00000100:00100000:3.0:1789448233.883140:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448233.883391:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768448 00000100:00100000:0.0:1789448233.883402:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768448 00000100:00100000:0.0:1789448233.883498:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 24 00000100:00100000:0.0:1789448233.883509:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18734:x1876371849768448:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448233.883529:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448233.883546:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4afb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8722e expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883611:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883625:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883635:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883686:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883695:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883702:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883930:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f400/0x6522da1199ce4b10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883951:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f400/0x6522da1199ce4b10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.883958:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f400/0x6522da1199ce4b10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448233.883968:0:22746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789448233.884124:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884131:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884138:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884144:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2f800 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:0.0:1789448233.884148:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884155:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884167:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9517c2848600) 00010000:00010000:0.0:1789448233.884170:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448233.884174:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884179:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f800/0x6522da1199ce4b02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884191:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884201:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884207:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884212:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e000 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:0.0:1789448233.884215:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884221:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884242:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9517c2848b00) 00010000:00010000:0.0:1789448233.884245:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448233.884248:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.884254:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4b09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.889930:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fa00/0x6522da1199ce4afb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8722e expref: 10 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.889955:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f400/0x6522da1199ce4b10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8722e expref: 9 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448233.889965:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9517c2848f00) 00010000:00010000:0.0:1789448233.889967:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448233.889984:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2f400, rc 0) 00000100:00100000:0.0:1789448233.890044:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18734:x1876371849768448:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 6536us (6912us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789448233.890052:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 24 00000100:00100000:0.0:1789448233.911285:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448233.914654:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768576 00000100:00100000:2.0:1789448233.914682:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768576 00000100:00100000:2.0:1789448233.914758:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 25 00000100:00100000:2.0:1789448233.914768:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18734:x1876371849768576:12345-192.168.206.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789448233.914883:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18734:x1876371849768576:12345-192.168.206.38@tcp:59:lhsmtool_posix.0 Request processed in 116us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448233.914902:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 25 00000100:00100000:1.0:1789448233.934822:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448233.935041:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768704 00000100:00100000:2.0:1789448233.935051:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768704 00000100:00100000:2.0:1789448233.935201:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 26 00000100:00100000:2.0:1789448233.935211:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:18734:x1876371849768704:12345-192.168.206.38@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789448233.935586:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789448233.961373:0:24273:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 26124us 00000040:00080000:1.0:1789448233.983738:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789448233.986011:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:18734:x1876371849768704:12345-192.168.206.38@tcp:59:lhsmtool_posix.0 Request processed in 50793us (51188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448233.986850:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 26 00000100:00100000:1.0:1789448233.991344:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448233.991419:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768832 00000100:00100000:2.0:1789448233.991428:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768832 00000100:00100000:2.0:1789448233.991518:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 27 00000100:00100000:2.0:1789448233.991528:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18740:x1876371849768832:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448233.991547:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448233.991568:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4b1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87235 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991629:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991642:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991653:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991705:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991712:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991719:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991758:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991777:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991784:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991790:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8400 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448233.991794:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991801:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991813:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:2.0:1789448233.991815:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448233.991820:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991826:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991838:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991844:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991849:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991855:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9e00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448233.991865:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991871:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991879:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9517f2687e00) 00010000:00010000:2.0:1789448233.991881:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448233.991883:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991889:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991936:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4b1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87235 expref: 10 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991945:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:2.0:1789448233.991947:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448233.991951:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87235 expref: 10 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448233.991959:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8800, rc 0) 00000100:00100000:2.0:1789448233.992016:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18740:x1876371849768832:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 490us (681us total) trans 0 rc 301/301 00000100:00100000:2.0:1789448233.992023:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 27 00000100:00100000:1.0:1789448234.005237:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.005323:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849768960 00000100:00100000:2.0:1789448234.005332:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849768960 00000100:00100000:2.0:1789448234.005381:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 0 00000100:00100000:2.0:1789448234.005392:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18740:x1876371849768960:12345-192.168.206.38@tcp:700:lfs.0 00000100:00100000:2.0:1789448234.005509:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18740:x1876371849768960:12345-192.168.206.38@tcp:700:lfs.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.005516:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 0 00000100:00100000:3.0:1789448234.010003:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448234.010079:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769216 00000100:00100000:1.0:1789448234.010101:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769216 00000100:00100000:1.0:1789448234.010162:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 28 00000100:00100000:1.0:1789448234.010172:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:18740:x1876371849769216:12345-192.168.206.38@tcp:36:lfs.0 00010000:00010000:1.0:1789448234.010222:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448234.010249:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95180207a800/0x6522da1199ce4a4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb871a2 expref: 9 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.010286:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:1.0:1789448234.010290:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448234.010345:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.010359:0:22746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 5 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.010367:0:22746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.010397:0:22746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 5 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.010410:0:22746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 5 pid: 22745 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448234.010424:0:22746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c82b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22746:1876371859310592:192.168.206.38@tcp:104: 00000100:00100000:1.0:1789448234.010546:0:22746:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517fd80fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789448234.020701:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.023956:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769344 00000100:00100000:2.0:1789448234.023971:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769344 00010000:00010000:2.0:1789448234.024042:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 6 pid: 22745 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448234.024364:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 15 00000100:00100000:2.0:1789448234.024376:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:2391:x1876371849769344:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448234.024391:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448234.024398:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 6 pid: 22745 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.024411:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 6 pid: 22745 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.024430:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:2.0:1789448234.024436:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.024445:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.024452:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.024503:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448234.024571:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:2391:x1876371849769344:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 197us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.024578:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 15 00010000:00010000:1.0:1789448234.024681:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517d90ef000/0x6522da1199ce4a8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87212 expref: 5 pid: 22745 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448234.024699:0:22746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c82b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22746:1876371859310592:192.168.206.38@tcp:104: 00010000:00010000:1.0:1789448234.024728:0:22746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.024737:0:22746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.024750:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.024770:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.024780:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.024788:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789448234.027140:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789448234.032583:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032604:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032616:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448234.032634:0:22746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099c5df9b reply state 000000003e8c6a22 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032646:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032653:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:1.0:1789448234.032656:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789448234.032660:0:22746:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789448234.032666:0:22746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789448234.032682:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032689:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032696:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032702:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0030a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448234.032706:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032714:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032726:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848400) 00010000:00010000:1.0:1789448234.032728:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448234.032732:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032739:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4b33 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448234.032757:0:22746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099c5df9b reply state 000000003e8c6a22 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032765:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.032771:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9517c3700b00) 00010000:00010000:1.0:1789448234.032774:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789448234.032782:0:22746:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789448234.032872:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+10:18740:x1876371849769216:12345-192.168.206.38@tcp:36:lfs.0 Request processed in 22697us (22873us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789448234.032881:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 28 00000100:00100000:0.0:1789448234.042024:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.042069:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.042100:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.042130:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.042162:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.042188:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769856 00000100:00100000:1.0:1789448234.042189:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769600 00000100:00100000:1.0:1789448234.042198:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769600 00000100:00100000:0.0:1789448234.042198:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769856 00000100:00100000:1.0:1789448234.042253:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769472 00000100:00100000:1.0:1789448234.042256:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769472 00000100:00100000:2.0:1789448234.042260:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769984 00000100:00100000:3.0:1789448234.042304:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00100000:3.0:1789448234.042317:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2389:x1876371849769600:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:3.0:1789448234.042380:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2389:x1876371849769600:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 68us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.042388:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00100000:2.0:1789448234.043440:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769984 00000100:00100000:3.0:1789448234.043641:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849769728 00000100:00100000:3.0:1789448234.043646:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849769728 00000100:00100000:0.0:1789448234.050660:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:0.0:1789448234.050676:0:24250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a3f413d-b754-460c-ba19-98579d387b28+5:2389:x1876371849769856:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448234.050755:0:24250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a3f413d-b754-460c-ba19-98579d387b28+5:2389:x1876371849769856:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 84us (8685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448234.050763:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:1.0:1789448234.059979:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00100000:1.0:1789448234.059993:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2389:x1876371849769472:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:1.0:1789448234.060071:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2389:x1876371849769472:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 81us (17970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448234.060078:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00080000:1.0:1789448234.060648:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789448234.060654:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789448234.060657:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789448234.065711:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 60 00000100:00100000:3.0:1789448234.065726:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a3f413d-b754-460c-ba19-98579d387b28+5:2389:x1876371849769728:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:3.0:1789448234.065826:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a3f413d-b754-460c-ba19-98579d387b28+5:2389:x1876371849769728:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 105us (23695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.065840:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 60 00000100:00100000:3.0:1789448234.068739:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00100000:3.0:1789448234.068754:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a3f413d-b754-460c-ba19-98579d387b28+5:2389:x1876371849769984:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:3.0:1789448234.068900:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a3f413d-b754-460c-ba19-98579d387b28+5:2389:x1876371849769984:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 150us (26736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.068908:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00100000:0.0:1789448234.126615:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448234.126717:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849770112 00000100:00100000:1.0:1789448234.126728:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849770112 00000100:00100000:0.0:1789448234.126867:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 29 00000100:00100000:0.0:1789448234.126878:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+10:18749:x1876371849770112:12345-192.168.206.38@tcp:101:lctl.0 00010000:00010000:0.0:1789448234.126922:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448234.126956:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e600/0x6522da1199ce4b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8723c expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.127021:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fe00/0x6522da1199ce4b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.127036:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fe00/0x6522da1199ce4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.127048:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fe00/0x6522da1199ce4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448234.127091:0:22746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789448234.127095:0:22746:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789448234.127133:0:22746:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fe00/0x6522da1199ce4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.127157:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e600/0x6522da1199ce4b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8723c expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.127174:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fe00/0x6522da1199ce4b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8723c expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.127182:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:0.0:1789448234.127185:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448234.127189:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2fe00, rc 0) 00000100:00100000:0.0:1789448234.127250:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+11:18749:x1876371849770112:12345-192.168.206.38@tcp:101:lctl.0 Request processed in 374us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448234.127257:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 29 00000100:00100000:1.0:1789448234.149141:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.149247:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849770240 00000100:00100000:2.0:1789448234.149258:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849770240 00000100:00100000:2.0:1789448234.149327:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 30 00000100:00100000:2.0:1789448234.149337:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+5:18750:x1876371849770240:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448234.149356:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.149376:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87243 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.149437:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.149452:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.149510:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.149554:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789448234.149557:0:22745:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789448234.149578:0:22745:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.149602:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87243 expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.149619:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8400/0x6522da1199ce4b5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87243 expref: 6 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.149640:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448234.149643:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448234.149646:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8400, rc 0) 00000100:00100000:2.0:1789448234.149697:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:18750:x1876371849770240:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 363us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.149704:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 30 00000100:00100000:3.0:1789448234.153420:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.153544:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849770368 00000100:00100000:0.0:1789448234.153565:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849770368 00000100:00100000:0.0:1789448234.153617:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 31 00000100:00100000:0.0:1789448234.153627:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a3f413d-b754-460c-ba19-98579d387b28+6:18750:x1876371849770368:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:0.0:1789448234.153643:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448234.153661:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ee00/0x6522da1199ce4b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8724a expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153720:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153733:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153744:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153755:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153762:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153769:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153849:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fc00/0x6522da1199ce4b79 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153857:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fc00/0x6522da1199ce4b79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.153864:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fc00/0x6522da1199ce4b79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448234.154164:0:22746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789448234.154168:0:22746:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789448234.154191:0:22746:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fc00/0x6522da1199ce4b79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154203:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154210:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154216:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154222:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e800 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:0.0:1789448234.154226:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154233:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154244:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:0.0:1789448234.154247:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448234.154251:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154257:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154269:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154286:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154293:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154297:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2ea00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:0.0:1789448234.154300:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154306:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154313:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9517c3700b00) 00010000:00010000:0.0:1789448234.154315:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789448234.154318:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154323:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ea00/0x6522da1199ce4b72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154346:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ee00/0x6522da1199ce4b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8724a expref: 8 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154357:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fc00/0x6522da1199ce4b79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8724a expref: 7 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.154364:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:0.0:1789448234.154366:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789448234.154373:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2fc00, rc 0) 00000100:00100000:0.0:1789448234.154604:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a3f413d-b754-460c-ba19-98579d387b28+7:18750:x1876371849770368:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 977us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448234.154612:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 31 00000100:00100000:0.0:1789448234.158294:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448234.158373:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849770496 00000100:00100000:3.0:1789448234.158381:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849770496 00000100:00100000:3.0:1789448234.158432:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 6 00000100:00100000:3.0:1789448234.158442:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a3f413d-b754-460c-ba19-98579d387b28+5:18750:x1876371849770496:12345-192.168.206.38@tcp:900:lfs.0 00000100:00100000:3.0:1789448234.158548:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a3f413d-b754-460c-ba19-98579d387b28+5:18750:x1876371849770496:12345-192.168.206.38@tcp:900:lfs.0 Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.158556:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 6 00000100:00100000:1.0:1789448234.161760:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.161853:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849770752 00000100:00100000:2.0:1789448234.161862:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849770752 00000100:00100000:2.0:1789448234.161913:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 32 00000100:00100000:2.0:1789448234.161922:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+7:18750:x1876371849770752:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448234.161938:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.161956:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87251 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.162045:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789448234.162130:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87251 expref: 9 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.162143:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448234.162146:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448234.162151:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87251 expref: 9 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.162163:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9e00, rc 0) 00000100:00100000:2.0:1789448234.162218:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+8:18750:x1876371849770752:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 297us (466us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1789448234.162240:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 32 00000100:00100000:0.0:1789448234.166088:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.166164:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849771008 00000100:00100000:2.0:1789448234.166174:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849771008 00000100:00100000:2.0:1789448234.166233:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 33 00000100:00100000:2.0:1789448234.166243:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+8:18750:x1876371849771008:12345-192.168.206.38@tcp:36:lfs.0 00010000:00010000:2.0:1789448234.166301:0:24273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448234.166326:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2fc00/0x6522da1199ce4b79 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8724a expref: 8 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.166343:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448234.166347:0:24273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448234.166368:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.166381:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.166392:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448234.166634:0:24273:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f6629dd reply state 00000000b73d70c0 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.166647:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.166654:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448234.166670:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789448234.166679:0:24273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789448234.166686:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789448234.166751:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+9:18750:x1876371849771008:12345-192.168.206.38@tcp:36:lfs.0 Request processed in 510us (669us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789448234.166759:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 33 00000100:00100000:0.0:1789448234.169562:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448234.169661:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849771264 00000100:00100000:1.0:1789448234.169671:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849771264 00000100:00100000:1.0:1789448234.169722:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 2 00000100:00100000:1.0:1789448234.169733:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a3f413d-b754-460c-ba19-98579d387b28+9:18750:x1876371849771264:12345-192.168.206.38@tcp:35:lfs.0 00000100:00100000:1.0:1789448234.169935:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a3f413d-b754-460c-ba19-98579d387b28+10:18750:x1876371849771264:12345-192.168.206.38@tcp:35:lfs.0 Request processed in 204us (382us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789448234.169941:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 2 00000100:00100000:1.0:1789448234.173049:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.173141:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849771520 00000100:00100000:2.0:1789448234.173150:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849771520 00000100:00100000:2.0:1789448234.173204:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 34 00000100:00100000:2.0:1789448234.173214:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+10:18750:x1876371849771520:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448234.173238:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.173258:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87258 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173337:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173350:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173360:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173371:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173378:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173384:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.173532:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789448234.173595:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173603:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173610:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173616:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9000 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448234.173621:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173628:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173640:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448234.173643:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448234.173648:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173654:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173664:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173671:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173689:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173694:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8c00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448234.173697:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173703:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173711:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9517c3700b00) 00010000:00010000:2.0:1789448234.173714:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448234.173717:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173722:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4ba3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173752:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87258 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173761:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448234.173763:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448234.173766:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87258 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.173776:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9e00, rc 0) 00000100:00100000:2.0:1789448234.173945:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+11:18750:x1876371849771520:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 732us (903us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1789448234.173961:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 34 00000100:00100000:3.0:1789448234.176628:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.176730:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849771648 00000100:00100000:2.0:1789448234.176740:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849771648 00000100:00100000:2.0:1789448234.176884:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 35 00000100:00100000:2.0:1789448234.176906:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+11:18750:x1876371849771648:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448234.176927:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.176945:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4bb1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8725f expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.177023:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.177036:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.177047:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.177068:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789448234.177072:0:24273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789448234.177089:0:24273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.177112:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4bb1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 13 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.177128:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 12 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.177154:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448234.177156:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789448234.177159:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8800, rc 0) 00000100:00100000:2.0:1789448234.177217:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+12:18750:x1876371849771648:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 323us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.180250:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448234.180585:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849771776 00000100:00100000:1.0:1789448234.180595:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849771776 00000100:00100000:1.0:1789448234.180649:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 3 00000100:00100000:1.0:1789448234.180658:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a3f413d-b754-460c-ba19-98579d387b28+13:18750:x1876371849771776:12345-192.168.206.38@tcp:37:lfs.0 00000100:00100000:3.0:1789448234.185493:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a3f413d-b754-460c-ba19-98579d387b28+13:18750:x1876371849771776:12345-192.168.206.38@tcp:37:lfs.0 Request processed in 4800us (5215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.185509:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 3 00000100:00100000:2.0:1789448234.191497:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 35 00000100:00100000:1.0:1789448234.192431:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448234.192686:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849772032 00000100:00100000:3.0:1789448234.192696:0:22748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849772032 00000100:00100000:3.0:1789448234.192750:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 4 00000100:00100000:3.0:1789448234.192761:0:22748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fc2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a3f413d-b754-460c-ba19-98579d387b28+12:18750:x1876371849772032:12345-192.168.206.38@tcp:35:lfs.0 00000100:00100000:3.0:1789448234.192978:0:22748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fc2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a3f413d-b754-460c-ba19-98579d387b28+13:18750:x1876371849772032:12345-192.168.206.38@tcp:35:lfs.0 Request processed in 218us (551us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789448234.192997:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 4 00000100:00100000:3.0:1789448234.242547:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.242684:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849772160 00000100:00100000:2.0:1789448234.242694:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849772160 00000100:00100000:2.0:1789448234.242752:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 36 00000100:00100000:2.0:1789448234.242762:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+11:18756:x1876371849772160:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:2.0:1789448234.242781:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.242810:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87266 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.242867:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.242881:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.242904:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.242916:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.242923:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.242946:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243014:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4bd4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243023:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243030:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.243062:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789448234.243066:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789448234.243100:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243111:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243118:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243124:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243129:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9e00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448234.243134:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243141:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243159:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448234.243162:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448234.243167:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243174:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243187:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243193:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243199:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243204:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8c00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448234.243207:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243213:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243220:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9517c3700b00) 00010000:00010000:2.0:1789448234.243222:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448234.243225:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243230:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243266:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87266 expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243280:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9000/0x6522da1199ce4bd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87266 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.243287:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448234.243290:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789448234.243292:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9000, rc 0) 00000100:00100000:2.0:1789448234.243355:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+12:18756:x1876371849772160:12345-192.168.206.38@tcp:101:bash.0 Request processed in 594us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.243362:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 36 00000100:00100000:0.0:1789448234.246349:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448234.246433:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849772288 00000100:00100000:3.0:1789448234.246442:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849772288 00000100:00100000:3.0:1789448234.246527:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:3.0:1789448234.246537:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:18756:x1876371849772288:12345-192.168.206.38@tcp:900:bash.0 00000100:00100000:3.0:1789448234.246619:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:18756:x1876371849772288:12345-192.168.206.38@tcp:900:bash.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.246626:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:3.0:1789448234.249417:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448234.249899:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849772544 00000100:00100000:0.0:1789448234.249909:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849772544 00000100:00100000:0.0:1789448234.249969:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 37 00000100:00100000:0.0:1789448234.249979:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+12:18756:x1876371849772544:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:0.0:1789448234.249998:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448234.250016:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f000/0x6522da1199ce4bdb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8726d expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.250129:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.250143:0:22746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 12 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.250151:0:22746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.250183:0:22746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 12 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448234.250197:0:22746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 12 pid: 24273 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448234.250221:0:22746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517f23a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22746:1876371859310720:192.168.206.38@tcp:104: 00000100:00100000:0.0:1789448234.250655:0:22746:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f93786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789448234.258835:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.258929:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849772672 00000100:00100000:2.0:1789448234.258938:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849772672 00010000:00010000:2.0:1789448234.258976:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 13 pid: 24273 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448234.259017:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 16 00000100:00100000:2.0:1789448234.259026:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a3f413d-b754-460c-ba19-98579d387b28+13:2391:x1876371849772672:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448234.259039:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448234.259045:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 13 pid: 24273 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.259057:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 13 pid: 24273 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.259106:0:22730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448234.259111:0:22730:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.259120:0:22730:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.259127:0:22730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.259144:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448234.259202:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a3f413d-b754-460c-ba19-98579d387b28+13:2391:x1876371849772672:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.259210:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 16 00010000:00010000:1.0:1789448234.264011:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8800/0x6522da1199ce4bb8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8725f expref: 12 pid: 24273 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448234.264040:0:22746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517f23a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22746:1876371859310720:192.168.206.38@tcp:104: 00010000:00010000:1.0:1789448234.264065:0:22746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264076:0:22746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264082:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264383:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264397:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264407:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264950:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264961:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.264984:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448234.264996:0:22746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789448234.265024:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.265031:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.265038:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.265044:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e800 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448234.265048:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.265055:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.265068:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:1.0:1789448234.265070:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448234.265075:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.265081:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e800/0x6522da1199ce4be2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448234.266328:0:22746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f5bd769 reply state 00000000207ebc65 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.266365:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.266373:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9517c3700100) 00010000:00010000:1.0:1789448234.266376:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789448234.266380:0:22746:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789448234.266426:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f000/0x6522da1199ce4bdb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 15 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.266443:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 14 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.266450:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448234.266452:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789448234.266454:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517c0031e00, rc 0) 00000100:00100000:1.0:1789448234.266548:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+15:18756:x1876371849772544:12345-192.168.206.38@tcp:101:bash.0 Request processed in 16570us (17138us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789448234.266557:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 37 00000100:00100000:0.0:1789448234.283166:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.283425:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849772800 00000100:00100000:2.0:1789448234.283435:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849772800 00000100:00100000:2.0:1789448234.283539:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 38 00000100:00100000:2.0:1789448234.283549:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+15:18756:x1876371849772800:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:2.0:1789448234.283572:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.283591:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4bfe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87274 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.283648:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.283662:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.283674:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.283730:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789448234.283734:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789448234.283752:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.283762:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.283979:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4bfe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87274 expref: 17 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.283999:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87274 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.284007:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448234.284010:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448234.284014:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8c00, rc 0) 00000100:00100000:2.0:1789448234.284109:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+16:18756:x1876371849772800:12345-192.168.206.38@tcp:101:bash.0 Request processed in 561us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.284117:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 38 00000100:00100000:0.0:1789448234.288197:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448234.288285:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849773056 00000100:00100000:3.0:1789448234.288295:0:22748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849773056 00000100:00100000:3.0:1789448234.288351:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 5 00000100:00100000:3.0:1789448234.288360:0:22748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+16:18756:x1876371849773056:12345-192.168.206.38@tcp:35:bash.0 00000100:00100000:3.0:1789448234.288653:0:22748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+17:18756:x1876371849773056:12345-192.168.206.38@tcp:35:bash.0 Request processed in 293us (462us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789448234.288661:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 5 00000040:00080000:3.0:1789448234.358166:0:23504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789448234.417421:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.417722:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849773312 00000100:00100000:2.0:1789448234.417732:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849773312 00000100:00100000:2.0:1789448234.417799:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 39 00000100:00100000:2.0:1789448234.417809:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+17:18766:x1876371849773312:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448234.417832:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448234.417850:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8727b expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448234.417977:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789448234.418064:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8727b expref: 19 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.418077:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448234.418080:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448234.418085:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8727b expref: 19 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.418098:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9c00, rc 0) 00000100:00100000:2.0:1789448234.418156:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+18:18766:x1876371849773312:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 348us (742us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789448234.418162:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 39 00000100:00100000:0.0:1789448234.427777:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448234.427870:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849773568 00000100:00100000:3.0:1789448234.427879:0:22748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849773568 00000100:00100000:3.0:1789448234.427936:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 6 00000100:00100000:3.0:1789448234.427946:0:22748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+18:18766:x1876371849773568:12345-192.168.206.38@tcp:35:lfs.0 00000100:00100000:3.0:1789448234.428328:0:22748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+19:18766:x1876371849773568:12345-192.168.206.38@tcp:35:lfs.0 Request processed in 381us (558us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1789448234.428337:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 6 00000100:00100000:0.0:1789448234.508533:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448234.508634:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849773824 00000100:00100000:1.0:1789448234.508644:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849773824 00000100:00100000:1.0:1789448234.508704:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 40 00000100:00100000:1.0:1789448234.508725:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+19:18769:x1876371849773824:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:1.0:1789448234.508747:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448234.508767:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4c1a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87282 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.508877:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4c21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.508916:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4c21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.508928:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4c21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448234.508939:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789448234.509037:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4c1a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87282 expref: 22 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.509055:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4c21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87282 expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.509063:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448234.509066:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448234.509069:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517c0031a00, rc 0) 00000100:00100000:1.0:1789448234.509136:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+21:18769:x1876371849773824:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 414us (612us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1789448234.509143:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 40 00000100:00100000:0.0:1789448234.517113:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.518403:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849773952 00000100:00100000:2.0:1789448234.518416:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849773952 00000100:00100000:2.0:1789448234.518540:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 0 00000100:00100000:2.0:1789448234.518550:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+21:2389:x1876371849773952:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448234.518565:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448234.518587:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4c21 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87282 expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.518605:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448234.518611:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448234.518673:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:2389:x1876371849773952:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 125us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.518695:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 0 00000100:00100000:0.0:1789448234.524515:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.524616:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849774080 00000100:00100000:2.0:1789448234.524626:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849774080 00000100:00100000:2.0:1789448234.524673:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 41 00000100:00100000:2.0:1789448234.524684:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:18769:x1876371849774080:12345-192.168.206.38@tcp:54:lfs.0 00010000:00010000:2.0:1789448234.524757:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524773:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524797:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524830:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524837:0:24273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524844:0:24273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524850:0:24273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9c00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448234.524854:0:24273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524862:0:24273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524874:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448234.524891:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448234.524899:0:24273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448234.524905:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c2f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448234.524966:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:18769:x1876371849774080:12345-192.168.206.38@tcp:54:lfs.0 Request processed in 283us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448234.524974:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 41 00000100:00100000:1.0:1789448234.538357:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.538549:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849774336 00000100:00100000:2.0:1789448234.538560:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849774336 00000100:00100000:2.0:1789448234.538606:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 7 00000100:00100000:2.0:1789448234.538616:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:18769:x1876371849774336:12345-192.168.206.38@tcp:35:lfs.0 00000100:00100000:2.0:1789448234.538862:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+21:18769:x1876371849774336:12345-192.168.206.38@tcp:35:lfs.0 Request processed in 247us (514us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789448234.538871:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 7 00010000:00010000:2.0:1789448234.615227:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448234.891542:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448234.891634:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849774592 00000100:00100000:1.0:1789448234.891644:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849774592 00000100:00100000:1.0:1789448234.891707:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 42 00000100:00100000:1.0:1789448234.891717:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+21:18800:x1876371849774592:12345-192.168.206.38@tcp:101:cat.0 00010000:00010000:1.0:1789448234.891738:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448234.891757:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4c36 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87289 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.891889:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4c3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.891903:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4c3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.891916:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4c3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789448234.891928:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789448234.892038:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4c36 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87289 expref: 24 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.892059:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4c3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87289 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448234.892067:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448234.892070:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448234.892073:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517c0031c00, rc 0) 00000100:00100000:1.0:1789448234.892133:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+23:18800:x1876371849774592:12345-192.168.206.38@tcp:101:cat.0 Request processed in 417us (601us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1789448234.892141:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 42 00000100:00100000:1.0:1789448234.906309:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448234.906416:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849774848 00000100:00100000:2.0:1789448234.906425:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849774848 00000100:00100000:2.0:1789448234.906519:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 8 00000100:00100000:2.0:1789448234.906529:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+23:18800:x1876371849774848:12345-192.168.206.38@tcp:35:cat.0 00000100:00100000:2.0:1789448234.906800:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+24:18800:x1876371849774848:12345-192.168.206.38@tcp:35:cat.0 Request processed in 271us (498us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789448234.906807:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 8 00000100:00100000:0.0:1789448234.917646:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448234.917738:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849774976 00000100:00100000:3.0:1789448234.917748:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849774976 00000100:00100000:3.0:1789448234.917818:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 1 00000100:00100000:3.0:1789448234.917827:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+24:2392:x1876371849774976:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448234.917842:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448234.917864:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4c3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87289 expref: 24 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448234.917883:0:22731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:3.0:1789448234.917888:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448234.917958:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+23:2392:x1876371849774976:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448234.917965:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 1 00000100:00100000:3.0:1789448235.012434:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448235.012717:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849775232 00000100:00100000:2.0:1789448235.012727:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849775232 00000100:00080000:1.0:1789448235.012865:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448235.012914:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 43 00000100:00100000:2.0:1789448235.012938:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+23:18806:x1876371849775232:12345-192.168.206.38@tcp:101:dd.0 00010000:00010000:2.0:1789448235.012963:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448235.012983:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c4b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87290 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.013079:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4c52 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.013094:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4c52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.013105:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4c52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448235.013117:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789448235.013243:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c4b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87290 expref: 26 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.013261:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4c52 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87290 expref: 25 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.013269:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448235.013272:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448235.013276:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9e00, rc 0) 00000100:00100000:2.0:1789448235.013644:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+25:18806:x1876371849775232:12345-192.168.206.38@tcp:101:dd.0 Request processed in 707us (1217us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789448235.013651:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 43 00000100:00100000:0.0:1789448235.021540:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448235.021620:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849775360 00000100:00100000:2.0:1789448235.021631:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849775360 00000100:00100000:2.0:1789448235.021702:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 44 00000100:00100000:2.0:1789448235.021712:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+25:18806:x1876371849775360:12345-192.168.206.38@tcp:101:dd.0 00010000:00010000:2.0:1789448235.021736:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448235.021754:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4c60 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87297 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.021799:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.021812:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.021823:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.021928:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4c60 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 27 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.021946:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 26 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.021954:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448235.021956:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789448235.021960:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8000, rc 0) 00000100:00100000:2.0:1789448235.022019:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+26:18806:x1876371849775360:12345-192.168.206.38@tcp:101:dd.0 Request processed in 309us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448235.022026:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 44 00000100:00100000:1.0:1789448235.025589:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448235.026673:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849775616 00000100:00100000:0.0:1789448235.026686:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849775616 00000100:00100000:0.0:1789448235.026747:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 45 00000100:00100000:0.0:1789448235.026756:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+26:18806:x1876371849775616:12345-192.168.206.38@tcp:36:dd.0 00010000:00010000:0.0:1789448235.026814:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789448235.026837:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9e00/0x6522da1199ce4c52 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87290 expref: 26 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.026855:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8c00/0x6522da1199ce4c05 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87274 expref: 25 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.026863:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.026880:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448235.027028:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.027040:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.027050:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448235.027085:0:22746:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1789448235.027107:0:22746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000922109f4 reply state 00000000794b0c38 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.027118:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.027124:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.027126:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789448235.027129:0:22746:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448235.027216:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+27:18806:x1876371849775616:12345-192.168.206.38@tcp:36:dd.0 Request processed in 460us (1633us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1789448235.027222:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 45 00000020:00080000:0.0:1789448235.027226:0:22746:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789448235.138342:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448235.138800:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849775872 00000100:00100000:2.0:1789448235.138810:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849775872 00000100:00100000:2.0:1789448235.138875:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 9 00000100:00100000:2.0:1789448235.138885:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+27:18806:x1876371849775872:12345-192.168.206.38@tcp:35:dd.0 00000100:00100000:2.0:1789448235.139114:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+28:18806:x1876371849775872:12345-192.168.206.38@tcp:35:dd.0 Request processed in 229us (780us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1789448235.139122:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 9 00000100:00100000:1.0:1789448235.355523:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448235.355797:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849776000 00000100:00100000:2.0:1789448235.355807:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849776000 00000100:00100000:2.0:1789448235.355871:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 46 00000100:00100000:2.0:1789448235.355881:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+28:18820:x1876371849776000:12345-192.168.206.38@tcp:101:stat.0 00010000:00010000:2.0:1789448235.355903:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448235.355921:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4c75 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8729e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.355979:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.355993:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356004:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356015:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356022:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356028:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356296:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356307:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356315:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448235.356351:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789448235.356356:0:22745:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789448235.356396:0:22745:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356407:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356416:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356423:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356430:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356436:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9c00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448235.356440:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356448:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356682:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448235.356685:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448235.356691:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356698:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9c00/0x6522da1199ce4c7c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356722:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356728:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356735:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356740:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9800 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448235.356743:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356749:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356757:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9517c3700100) 00010000:00010000:2.0:1789448235.356759:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448235.356762:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356769:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4c83 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356818:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4c75 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8729e expref: 30 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356832:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8729e expref: 29 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.356839:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448235.356842:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789448235.356849:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e9200, rc 0) 00000100:00100000:3.0:1789448235.357275:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+29:18820:x1876371849776000:12345-192.168.206.38@tcp:101:stat.0 Request processed in 1393us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448235.357285:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 46 00000100:00100000:1.0:1789448235.421545:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448235.421798:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849776256 00000100:00100000:0.0:1789448235.421808:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849776256 00000100:00100000:0.0:1789448235.421978:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 47 00000100:00100000:0.0:1789448235.421990:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+29:18826:x1876371849776256:12345-192.168.206.38@tcp:36:truncate.0 00010000:00010000:0.0:1789448235.422042:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448235.422071:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9200/0x6522da1199ce4c8a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8729e expref: 29 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.422104:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.422109:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789448235.422279:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.422294:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.422303:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448235.422342:0:22746:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1789448235.422364:0:22746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bf111f4 reply state 00000000259277cc transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.422376:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.422382:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.422385:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789448235.422388:0:22746:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448235.422544:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+31:18826:x1876371849776256:12345-192.168.206.38@tcp:36:truncate.0 Request processed in 556us (1006us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789448235.422551:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 47 00000020:00080000:0.0:1789448235.422555:0:22746:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789448235.571207:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448235.571293:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849776384 00000100:00100000:3.0:1789448235.571304:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849776384 00000100:00100000:3.0:1789448235.571377:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 48 00000100:00100000:3.0:1789448235.571387:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+31:18840:x1876371849776384:12345-192.168.206.38@tcp:101:stat.0 00010000:00010000:3.0:1789448235.571411:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448235.571431:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009400/0x6522da1199ce4c98 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872a5 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571534:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571561:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571572:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571585:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571592:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571599:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571683:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571692:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571700:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448235.571817:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1789448235.571822:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789448235.571843:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571856:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571874:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571880:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571886:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571892:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8008e00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:3.0:1789448235.571896:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571903:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571915:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:3.0:1789448235.571918:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448235.571922:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571928:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4c9f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571941:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571947:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571953:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571964:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8008a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:3.0:1789448235.571967:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571973:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571981:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9517c3700100) 00010000:00010000:3.0:1789448235.571984:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789448235.571987:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.571992:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4ca6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.572016:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009400/0x6522da1199ce4c98 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 33 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.572028:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 32 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.572035:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:3.0:1789448235.572037:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789448235.572039:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8008c00, rc 0) 00000100:00100000:3.0:1789448235.572152:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+32:18840:x1876371849776384:12345-192.168.206.38@tcp:101:stat.0 Request processed in 766us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448235.572160:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 48 00010000:00010000:3.0:1789448235.638058:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789448235.684049:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448235.684214:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849776640 00000100:00100000:2.0:1789448235.684223:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849776640 00000100:00100000:2.0:1789448235.684282:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 49 00000100:00100000:2.0:1789448235.684291:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+32:18850:x1876371849776640:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:2.0:1789448235.684309:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448235.684326:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872ac expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448235.684407:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789448235.684545:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4cb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872ac expref: 34 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.684558:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:2.0:1789448235.684561:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789448235.684566:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8200/0x6522da1199ce4cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872ac expref: 34 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.684590:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8200, rc 0) 00000100:00100000:2.0:1789448235.684652:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+33:18850:x1876371849776640:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 362us (611us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1789448235.684671:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 49 00000100:00100000:2.0:1789448235.698487:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448235.699628:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849776896 00000100:00100000:1.0:1789448235.699641:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849776896 00000100:00100000:1.0:1789448235.699702:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:1.0:1789448235.699711:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fc2ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+33:18850:x1876371849776896:12345-192.168.206.38@tcp:35:lfs.0 00000100:00100000:1.0:1789448235.699938:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fc2ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+34:18850:x1876371849776896:12345-192.168.206.38@tcp:35:lfs.0 Request processed in 227us (1489us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789448235.699945:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 10 00000100:00100000:1.0:1789448235.793240:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448235.793330:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849777152 00000100:00100000:3.0:1789448235.793340:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849777152 00000100:00100000:3.0:1789448235.793398:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 50 00000100:00100000:3.0:1789448235.793408:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+34:18856:x1876371849777152:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:3.0:1789448235.793429:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448235.793447:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009400/0x6522da1199ce4cc2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872b3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793595:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793608:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793616:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 35 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793623:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793653:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 35 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793665:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 35 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448235.793678:0:22744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c833ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22744:1876371859310848:192.168.206.38@tcp:104: 00010000:00010000:3.0:1789448235.793778:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.793801:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448235.793810:0:22744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c833a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22744:1876371859310976:192.168.206.38@tcp:104: 00000100:00100000:3.0:1789448235.793837:0:22744:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c82e20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448235.798555:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448235.798657:0:22744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c833ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22744:1876371859310848:192.168.206.38@tcp:104: 00000100:00100000:0.0:1789448235.798729:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849777280 00000100:00100000:0.0:1789448235.798737:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849777280 00010000:00010000:0.0:1789448235.798773:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 36 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448235.799060:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 17 00000100:00100000:0.0:1789448235.799071:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+36:2392:x1876371849777280:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448235.799085:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448235.799092:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 36 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.799105:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 36 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.799128:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008c00/0x6522da1199ce4cad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872a5 expref: 36 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.799141:0:22730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.799146:0:22730:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.799367:0:22730:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.799375:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789448235.799430:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+35:2392:x1876371849777280:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 361us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448235.799438:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 17 00000100:00100000:3.0:1789448235.806903:0:22744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c833a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22744:1876371859310976:192.168.206.38@tcp:104: 00010000:00010000:3.0:1789448235.806934:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448235.818715:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448235.819212:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849777408 00000100:00100000:1.0:1789448235.819222:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849777408 00010000:00010000:1.0:1789448235.819269:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448235.819305:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 18 00000100:00100000:1.0:1789448235.819314:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c81ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+35:2391:x1876371849777408:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448235.819328:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448235.819334:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.819347:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.819367:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4bf0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb8726d expref: 35 pid: 22746 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.819383:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448235.819388:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.819423:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.819430:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.819520:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448235.819564:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c81ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+34:2391:x1876371849777408:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 250us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448235.819572:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 18 00010000:00010000:2.0:1789448235.820597:0:22744:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.820608:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448235.820626:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789448235.820758:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009400/0x6522da1199ce4cc2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 35 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.820789:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 34 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.820797:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448235.820799:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789448235.820802:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8008a00, rc 0) 00000100:00100000:2.0:1789448235.820849:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+34:18856:x1876371849777152:12345-192.168.206.38@tcp:101:bash.0 Request processed in 27443us (27617us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1789448235.820857:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 50 00000100:00100000:2.0:1789448235.850044:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448235.850340:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849777664 00000100:00100000:0.0:1789448235.850349:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849777664 00000100:00100000:0.0:1789448235.850406:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 51 00000100:00100000:0.0:1789448235.850429:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+34:18856:x1876371849777664:12345-192.168.206.38@tcp:36:bash.0 00010000:00010000:0.0:1789448235.850681:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.850700:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.850711:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789448235.850752:0:24273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1789448235.850776:0:24273:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acabea6e reply state 000000003320d6cc transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.850788:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.850795:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.850798:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789448235.850802:0:24273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789448235.850906:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517e7051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18856:x1876371849777664:12345-192.168.206.38@tcp:36:bash.0 Request processed in 477us (869us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1789448235.850913:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 51 00000020:00080000:0.0:1789448235.850917:0:24273:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789448235.853541:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448235.853627:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849777792 00000100:00100000:3.0:1789448235.853637:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849777792 00000100:00100000:3.0:1789448235.853699:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 52 00000100:00100000:3.0:1789448235.853708:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18856:x1876371849777792:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:3.0:1789448235.853729:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448235.853747:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4cde lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872ba expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.853809:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4cde lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872ba expref: 38 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.853824:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4cde lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872ba expref: 38 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.853841:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:3.0:1789448235.853856:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448235.853860:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8008e00, rc 0) 00000100:00100000:3.0:1789448235.854056:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18856:x1876371849777792:12345-192.168.206.38@tcp:101:bash.0 Request processed in 348us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448235.854063:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 52 00000100:00100000:2.0:1789448235.866529:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448235.867686:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849777920 00000100:00100000:0.0:1789448235.867697:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849777920 00000100:00100000:0.0:1789448235.867763:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 53 00000100:00100000:0.0:1789448235.867779:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18856:x1876371849777920:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:0.0:1789448235.867802:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448235.867820:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e600/0x6522da1199ce4ce5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872c1 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.867926:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.867940:0:24273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 39 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.867949:0:24273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.867980:0:24273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 39 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.867993:0:24273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 39 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448235.868005:0:24273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef906a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24273:1876371859311104:192.168.206.38@tcp:104: 00000100:00100000:0.0:1789448235.868077:0:24273:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f93786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789448235.874363:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448235.874497:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849778048 00000100:00100000:2.0:1789448235.874506:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849778048 00010000:00010000:2.0:1789448235.874544:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 40 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448235.874572:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 19 00000100:00100000:2.0:1789448235.874582:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+40:2392:x1876371849778048:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448235.874596:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448235.874602:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 40 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.874614:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 40 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.874634:0:22730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448235.874639:0:22730:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.874647:0:22730:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.874654:0:22730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448235.874672:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448235.874728:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+40:2392:x1876371849778048:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448235.874752:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 19 00010000:00010000:0.0:1789448235.874886:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008a00/0x6522da1199ce4cc9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872b3 expref: 39 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448235.874922:0:24273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef906a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24273:1876371859311104:192.168.206.38@tcp:104: 00010000:00010000:0.0:1789448235.874942:0:24273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.874951:0:24273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.874967:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789448235.875019:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789448235.875024:0:24273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789448235.875044:0:24273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.875073:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e600/0x6522da1199ce4ce5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c1 expref: 39 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.875213:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c1 expref: 38 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448235.875221:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:0.0:1789448235.875224:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789448235.875227:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2f200, rc 0) 00000100:00100000:0.0:1789448235.875312:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18856:x1876371849777920:12345-192.168.206.38@tcp:101:bash.0 Request processed in 7539us (8791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448235.875319:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 53 00000100:00100000:1.0:1789448235.886358:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448235.886567:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849778304 00000100:00100000:3.0:1789448235.886577:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849778304 00000100:00100000:3.0:1789448235.886834:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 2 00000100:00100000:3.0:1789448235.886847:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c82b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18856:x1876371849778304:12345-192.168.206.38@tcp:103:bash.0 00010000:00010000:3.0:1789448235.886862:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789448235.886897:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4cde lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872ba expref: 38 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.886933:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2f200/0x6522da1199ce4cec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c1 expref: 37 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.886944:0:22731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:3.0:1789448235.886949:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448235.887004:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c82b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+36:18856:x1876371849778304:12345-192.168.206.38@tcp:103:bash.0 Request processed in 161us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448235.887010:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 2 00000100:00100000:2.0:1789448235.892545:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448235.892622:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849778432 00000100:00100000:3.0:1789448235.892632:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849778432 00000100:00100000:3.0:1789448235.892692:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 54 00000100:00100000:3.0:1789448235.892710:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+36:18856:x1876371849778432:12345-192.168.206.38@tcp:58:bash.0 00010000:00010000:3.0:1789448235.892801:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.892834:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448235.892846:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789448235.903132:0:22744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789448235.903165:0:22744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789448235.903287:0:22744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789448235.904596:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+36:18856:x1876371849778432:12345-192.168.206.38@tcp:58:bash.0 Request processed in 11870us (12035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448235.904608:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 54 00000100:00100000:0.0:1789448235.911348:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448235.911493:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849778560 00000100:00100000:1.0:1789448235.911503:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849778560 00000100:00100000:1.0:1789448235.911775:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 55 00000100:00100000:1.0:1789448235.911785:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+36:18856:x1876371849778560:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:1.0:1789448235.911804:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448235.911822:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872c8 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.911871:0:22746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.911882:0:22746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 37 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.911900:0:22746:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.912024:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 37 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.912038:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448235.912041:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789448235.912045:0:22746:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 37 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448235.912053:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517c0031800, rc 0) 00000100:00100000:1.0:1789448235.912190:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18856:x1876371849778560:12345-192.168.206.38@tcp:101:bash.0 Request processed in 406us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448235.912198:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 55 00000040:00080000:0.0:1789448236.021993:0:22780:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789448236.022014:0:22780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789448236.022041:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789448236.022049:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789448236.022183:0:22780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef904000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22780:1876371859311232:192.168.206.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789448236.022858:0:22780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1789448236.035220:0:22780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef904000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22780:1876371859311232:192.168.206.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789448236.036058:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.044092:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849778688 00000100:00100000:1.0:1789448236.044107:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849778688 00000100:00100000:0.0:1789448236.044265:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 56 00000100:00100000:0.0:1789448236.044277:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18857:x1876371849778688:12345-192.168.206.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789448236.044307:0:22745:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789448236.044430:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18857:x1876371849778688:12345-192.168.206.38@tcp:53:lhsmtool_posix.0 Request processed in 155us (8374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448236.044437:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 56 00000100:00100000:0.0:1789448236.054342:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.054521:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849778816 00000100:00100000:2.0:1789448236.054531:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849778816 00000100:00100000:2.0:1789448236.054592:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 57 00000100:00100000:2.0:1789448236.054602:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18857:x1876371849778816:12345-192.168.206.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789448236.054993:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055011:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055022:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055059:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055067:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055075:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055097:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055105:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055131:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789448236.055177:0:24273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789448236.055181:0:24273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789448236.055196:0:24273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055207:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055213:0:24273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055220:0:24273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055226:0:24273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.055231:0:24273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055238:0:24273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055249:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9517c2848f00) 00010000:00010000:2.0:1789448236.055326:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448236.055333:0:24273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055340:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055365:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055372:0:24273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055378:0:24273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055383:0:24273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9400 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.055386:0:24273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055393:0:24273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055401:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9517f2687e00) 00010000:00010000:2.0:1789448236.055403:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448236.055406:0:24273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055412:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055426:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055433:0:24273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055438:0:24273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055448:0:24273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.055604:0:24273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055610:0:24273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055619:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448236.055621:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448236.055625:0:24273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.055630:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9a00/0x6522da1199ce4d0f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448236.055728:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18857:x1876371849778816:12345-192.168.206.38@tcp:34:lhsmtool_posix.0 Request processed in 1126us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.055738:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 57 00000100:00100000:1.0:1789448236.061224:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.061322:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849779072 00000100:00100000:3.0:1789448236.061331:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849779072 00000100:00100000:3.0:1789448236.061384:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 58 00000100:00100000:3.0:1789448236.061393:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+37:18857:x1876371849779072:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448236.061411:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448236.061428:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872cf expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061547:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061561:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061571:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448236.061581:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789448236.061647:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061656:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061675:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061680:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8009800 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:3.0:1789448236.061684:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061691:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061716:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:3.0:1789448236.061719:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789448236.061724:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061730:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d1d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061778:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d16 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872cf expref: 39 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061787:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9517c2848f00) 00010000:00010000:3.0:1789448236.061789:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448236.061793:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872cf expref: 39 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.061803:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8008e00, rc 0) 00000100:00100000:3.0:1789448236.061859:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18857:x1876371849779072:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 466us (642us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1789448236.061874:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 58 00000100:00100000:1.0:1789448236.065956:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.066245:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849779200 00000100:00100000:3.0:1789448236.066263:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849779200 00000100:00100000:3.0:1789448236.079014:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 59 00000100:00100000:3.0:1789448236.079034:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f23a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18857:x1876371849779200:12345-192.168.206.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789448236.079080:0:22746:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789448236.079200:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f23a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18857:x1876371849779200:12345-192.168.206.38@tcp:53:lhsmtool_posix.0 Request processed in 173us (13251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448236.079207:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 59 00000100:00100000:3.0:1789448236.083482:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.087712:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849779456 00000100:00100000:1.0:1789448236.087727:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849779456 00000100:00100000:1.0:1789448236.087857:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 60 00000100:00100000:1.0:1789448236.088268:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+38:18857:x1876371849779456:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448236.088288:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448236.088309:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4d2b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872d6 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789448236.089218:0:22745:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1789448236.089227:0:22745:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1789448236.089263:0:22745:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1789448236.089411:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4d32 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.089427:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4d32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.089437:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4d32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.089721:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4d2b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872d6 expref: 41 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.089741:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4d32 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872d6 expref: 40 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.089750:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700600) 00010000:00010000:1.0:1789448236.089752:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789448236.089756:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517c0030a00, rc 0) 00000100:00100000:1.0:1789448236.090016:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+40:18857:x1876371849779456:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 2148us (6570us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1789448236.090025:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 60 00000100:00100000:1.0:1789448236.093620:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.093868:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849779712 00000100:00100000:2.0:1789448236.093878:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849779712 00000100:00100000:2.0:1789448236.093935:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 61 00000100:00100000:2.0:1789448236.093945:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+40:18857:x1876371849779712:12345-192.168.206.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789448236.094018:0:24273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448236.094043:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030a00/0x6522da1199ce4d32 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872d6 expref: 40 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.094062:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700600) 00010000:00010000:2.0:1789448236.094072:0:24273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448236.095204:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095222:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095233:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095292:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095300:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095307:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095357:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095364:0:24273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095371:0:24273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095376:0:24273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e9400 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.095380:0:24273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095386:0:24273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095410:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:2.0:1789448236.095413:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448236.095418:0:24273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095424:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9400/0x6522da1199ce4d40 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095436:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095442:0:24273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095447:0:24273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095498:0:24273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.095501:0:24273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095508:0:24273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095516:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x74860faa (ffff9517f2687e00) 00010000:00010000:2.0:1789448236.095518:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448236.095521:0:24273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.095526:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8a00/0x6522da1199ce4d47 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x74860faa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448236.096059:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+39:18857:x1876371849779712:12345-192.168.206.38@tcp:36:lhsmtool_posix.0 Request processed in 2111us (2442us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789448236.096068:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 61 00000100:00100000:2.0:1789448236.103340:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.103394:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849779840 00000100:00100000:3.0:1789448236.103404:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849779840 00000100:00100000:1.0:1789448236.103572:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 62 00000100:00100000:1.0:1789448236.103584:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+39:18857:x1876371849779840:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789448236.103612:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789448236.103634:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4d4e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872dd expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.103689:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4d55 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.103714:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4d55 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.103726:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4d55 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.103830:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031c00/0x6522da1199ce4d4e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872dd expref: 41 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.103847:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031e00/0x6522da1199ce4d55 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872dd expref: 40 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.103856:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:1.0:1789448236.103859:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789448236.103862:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517c0031e00, rc 0) 00000100:00100000:1.0:1789448236.104523:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+40:18857:x1876371849779840:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 938us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448236.104531:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 62 00000100:00100000:3.0:1789448236.108053:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.108531:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849780096 00000100:00100000:1.0:1789448236.108542:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849780096 00000100:00100000:1.0:1789448236.108710:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 63 00000100:00100000:1.0:1789448236.108721:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+40:18857:x1876371849780096:12345-192.168.206.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789448236.108805:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.108839:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.108851:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789448236.109022:0:22746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1789448236.109031:0:22746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638326569978ns, next at 639326567674ns, rc = 0 00000004:00010000:1.0:1789448236.109093:0:22746:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000577bf93f reply state 00000000798b5f53 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.109106:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.109113:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:1.0:1789448236.109116:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789448236.109119:0:22746:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789448236.109216:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+42:18857:x1876371849780096:12345-192.168.206.38@tcp:36:lhsmtool_posix.0 Request processed in 497us (1171us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1789448236.109224:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 63 00000100:00100000:2.0:1789448236.113551:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.113680:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849780224 00000100:00100000:3.0:1789448236.113690:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849780224 00000100:00100000:3.0:1789448236.113750:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 64 00000100:00100000:3.0:1789448236.113760:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+42:18857:x1876371849780224:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448236.113793:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448236.113812:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872e4 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.113869:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 43 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.113883:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 43 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.113920:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:3.0:1789448236.113924:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789448236.113927:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8008e00, rc 0) 00000100:00100000:3.0:1789448236.113975:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+43:18857:x1876371849780224:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 217us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448236.113981:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 64 00000100:00100000:2.0:1789448236.118897:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.118993:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849780352 00000100:00100000:1.0:1789448236.119002:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849780352 00000100:00100000:1.0:1789448236.119076:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00100000:1.0:1789448236.119086:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c83af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2392:x1876371849780352:12345-192.168.206.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789448236.119336:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c83af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2392:x1876371849780352:12345-192.168.206.38@tcp:2:lhsmtool_posix.0 Request processed in 251us (445us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1789448236.119344:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00080000:0.0:1789448236.119414:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789448236.122297:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.122488:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849780608 00000100:00100000:1.0:1789448236.122510:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849780608 00000100:00100000:1.0:1789448236.122562:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 11 00000100:00100000:1.0:1789448236.122571:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+43:18857:x1876371849780608:12345-192.168.206.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789448236.122789:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+44:18857:x1876371849780608:12345-192.168.206.38@tcp:35:lhsmtool_posix.0 Request processed in 217us (498us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1789448236.122797:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 11 00000100:00100000:3.0:1789448236.125271:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.125377:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849780864 00000100:00100000:2.0:1789448236.125386:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849780864 00000100:00100000:2.0:1789448236.125447:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 65 00000100:00100000:2.0:1789448236.125501:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+44:18857:x1876371849780864:12345-192.168.206.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789448236.125602:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+44:18857:x1876371849780864:12345-192.168.206.38@tcp:57:lhsmtool_posix.0 Request processed in 104us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.125609:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 65 00000100:00100000:2.0:1789448236.129150:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.129236:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849780992 00000100:00100000:3.0:1789448236.129245:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849780992 00000100:00100000:3.0:1789448236.129313:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 66 00000100:00100000:3.0:1789448236.129323:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+44:18857:x1876371849780992:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789448236.129340:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448236.129358:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d6a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872eb expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.129417:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009e00/0x6522da1199ce4d71 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.129430:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009e00/0x6522da1199ce4d71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.129441:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009e00/0x6522da1199ce4d71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448236.129547:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789448236.129564:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009e00/0x6522da1199ce4d71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.129607:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4d6a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872eb expref: 46 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.129622:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009e00/0x6522da1199ce4d71 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872eb expref: 45 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.129630:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:3.0:1789448236.129633:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789448236.129636:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8009e00, rc 0) 00000100:00100000:3.0:1789448236.129695:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+45:18857:x1876371849780992:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 373us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448236.129709:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 66 00000100:00100000:0.0:1789448236.137581:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.137909:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849781120 00000100:00100000:2.0:1789448236.137920:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849781120 00000100:00100000:2.0:1789448236.137972:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00100000:2.0:1789448236.137981:0:24250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+6:2391:x1876371849781120:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789448236.137998:0:24250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789448236.138016:0:24250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872f2 expref: -99 pid: 24250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789448236.138041:0:24250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8d02c, blocks: 0x0 00010000:00010000:2.0:1789448236.138060:0:24250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=638s v=(0 0) 00010000:00010000:2.0:1789448236.138065:0:24250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789448236.138088:0:24250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 7 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.138109:0:24250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 7 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.138123:0:24250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9517fd7e8200, rc 0) 00000100:00100000:2.0:1789448236.138186:0:24250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:2391:x1876371849781120:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 206us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.138193:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00100000:2.0:1789448236.142613:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448236.142802:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849781376 00000100:00100000:0.0:1789448236.142811:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849781376 00000100:00100000:0.0:1789448236.142870:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 67 00000100:00100000:0.0:1789448236.142880:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+45:18857:x1876371849781376:12345-192.168.206.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789448236.142981:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+45:18857:x1876371849781376:12345-192.168.206.38@tcp:57:lhsmtool_posix.0 Request processed in 102us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448236.142989:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 67 00000100:00100000:0.0:1789448236.146571:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.148609:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849781504 00000100:00100000:3.0:1789448236.148622:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849781504 00000100:00100000:2.0:1789448236.157336:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 68 00000100:00100000:2.0:1789448236.157352:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+45:18857:x1876371849781504:12345-192.168.206.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789448236.162938:0:22725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:3.0:1789448236.162953:0:22725:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789448236.163014:0:22725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1789448236.163075:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.163087:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.163094:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.163100:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8e00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:3.0:1789448236.163104:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.163123:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.163138:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:3.0:1789448236.163141:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789448236.163146:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.163152:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8e00/0x6522da1199ce4b8e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448236.163586:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:18857:x1876371849781504:12345-192.168.206.38@tcp:44:lhsmtool_posix.0 Request processed in 6233us (17019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.163597:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 68 00000100:00100000:3.0:1789448236.163680:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859311360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789448236.163744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448236.163918:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859311360 00000100:00100000:2.0:1789448236.163925:0:24249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859311360 00000100:00100000:2.0:1789448236.163973:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789448236.163981:0:24249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859311360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789448236.164107:0:24249:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789448236.164110:0:24249:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789448236.164113:0:24249:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789448236.164115:0:24249:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789448236 -> 1789448236 00002000:00010000:2.0:1789448236.164117:0:24249:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789448236.164149:0:24249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1876371859311360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 169us (405us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789448236.164165:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789448236.164186:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789448236.164409:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9517ef907100/2, rc 0, transno 12884901892 00000100:00100000:3.0:1789448236.164415:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859311360:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789448236.167155:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167171:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167179:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167185:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031200 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167189:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167197:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167212:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9517c3700b00) 00010000:00010000:1.0:1789448236.167216:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.167220:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167227:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4b3a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167276:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167283:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167288:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167293:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0030200 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167296:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167301:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167308:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:1.0:1789448236.167311:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.167313:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167318:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4b41 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167333:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167340:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167346:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167357:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031400 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167362:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167368:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167376:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9517c3700100) 00010000:00010000:1.0:1789448236.167378:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.167381:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167386:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4be9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167400:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167406:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167412:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167417:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e200 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167419:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167425:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167444:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448236.167446:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.167475:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167482:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e200/0x6522da1199ce4c6e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167493:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167498:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167502:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167507:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e000 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167509:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167514:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167521:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448236.167523:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.167526:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167531:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4c91 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167550:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167555:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167561:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167566:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2ec00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167570:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167575:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167581:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448236.167583:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.167586:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167591:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2ec00/0x6522da1199ce4cd7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167600:0:3618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167605:0:3618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167611:0:3618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167622:0:3618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.167625:0:3618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167631:0:3618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167638:0:3618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:1.0:1789448236.167640:0:3618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789448236.167643:0:3618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.167648:0:3618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d5c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448236.168221:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.171631:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849781632 00000100:00100000:2.0:1789448236.171646:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849781632 00000100:00100000:2.0:1789448236.171871:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:2.0:1789448236.171883:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517f2292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:2391:x1876371849781632:12345-192.168.206.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789448236.171997:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517f2292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:2391:x1876371849781632:12345-192.168.206.38@tcp:16:lhsmtool_posix.0 Request processed in 116us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.172003:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:0.0:1789448236.175091:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.175370:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849781888 00000100:00100000:2.0:1789448236.175380:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849781888 00000100:00100000:2.0:1789448236.175440:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 69 00000100:00100000:2.0:1789448236.175500:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+14:18857:x1876371849781888:12345-192.168.206.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789448236.175552:0:24273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448236.175575:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009e00/0x6522da1199ce4d71 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872eb expref: 14 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.175593:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:2.0:1789448236.175598:0:24273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789448236.175625:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4d7f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.175639:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4d7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.175648:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4d7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789448236.175805:0:24273:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cb4e2d8 reply state 00000000d7672109 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4d7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.175818:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e9800/0x6522da1199ce4d7f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.175825:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:2.0:1789448236.175828:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789448236.175831:0:24273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789448236.175919:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+15:18857:x1876371849781888:12345-192.168.206.38@tcp:36:lhsmtool_posix.0 Request processed in 470us (836us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1789448236.175926:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 69 00000100:00100000:3.0:1789448236.179003:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448236.179103:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782016 00000100:00100000:0.0:1789448236.179124:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782016 00000100:00100000:0.0:1789448236.179177:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 24 00000100:00100000:0.0:1789448236.179187:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18857:x1876371849782016:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789448236.179203:0:25215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448236.179219:0:25215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb872f9 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.179248:0:25215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.179268:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448236.179273:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448236.179278:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 8 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.179309:0:25215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.179322:0:25215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 738 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448236.179335:0:25215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef904700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25215:1876371859311488:192.168.206.38@tcp:104: 00000100:00100000:0.0:1789448236.179407:0:25215:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f27ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1789448236.185263:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448236.185652:0:25215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef904700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25215:1876371859311488:192.168.206.38@tcp:104: 00010000:00010000:0.0:1789448236.185683:0:25215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 8 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.185733:0:25215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2ee00, rc 0) 00000100:00100000:0.0:1789448236.185802:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:18857:x1876371849782016:12345-192.168.206.38@tcp:101:lhsmtool_posix.0 Request processed in 6617us (6807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448236.185811:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 24 00000100:00100000:1.0:1789448236.186369:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782144 00000100:00100000:1.0:1789448236.186377:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782144 00010000:00010000:1.0:1789448236.186408:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 738 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.186443:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00100000:1.0:1789448236.186495:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2392:x1876371849782144:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789448236.186509:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789448236.186529:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 738 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.186542:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 738 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.186572:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eecbb98/0x6522da1199ce4d78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f2 expref: 8 pid: 24250 timeout: 738 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.186584:0:22732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448236.186587:0:22732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448236.186593:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 7 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.186604:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 7 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.186633:0:22732:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 7 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.186646:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22732:1876371859311616:192.168.206.38@tcp:105: 00000100:00100000:1.0:1789448236.186697:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da240 going to sleep for 11 seconds 00000100:00100000:3.0:1789448236.190202:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.190305:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782272 00000100:00100000:2.0:1789448236.190315:0:24251:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782272 00000100:00100000:2.0:1789448236.190372:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 25 00000100:00100000:2.0:1789448236.190382:0:24251:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2391:x1876371849782272:12345-192.168.206.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789448236.190562:0:24251:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789448236.190566:0:24251:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789448235 00002000:00010000:2.0:1789448236.190568:0:24251:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789448234 00002000:00010000:2.0:1789448236.190570:0:24251:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789448236 -> 1789448235 00002000:00010000:2.0:1789448236.190572:0:24251:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789448236.190635:0:24251:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:2391:x1876371849782272:12345-192.168.206.38@tcp:2:lhsmtool_posix.0 Request processed in 241us (428us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789448236.190643:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 25 00000100:00100000:1.0:1789448236.193010:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22732:1876371859311616:192.168.206.38@tcp:105: 00010000:00010000:1.0:1789448236.193033:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789448236.193255:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2392:x1876371849782144:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 6801us (8008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448236.193265:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 20 00000100:00100000:2.0:1789448236.200308:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.200659:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782400 00000100:00100000:1.0:1789448236.200668:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782400 00000100:00100000:1.0:1789448236.200726:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 26 00000100:00100000:1.0:1789448236.200749:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2389:x1876371849782400:12345-192.168.206.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789448236.200801:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.200821:0:25219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 8 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.200830:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789448236.200835:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789448236.200840:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.200873:0:25219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 8 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.200887:0:25219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 8 pid: 25215 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.200900:0:25219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25219:1876371859311744:192.168.206.38@tcp:104: 00000100:00100000:1.0:1789448236.200965:0:25219:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448236.210838:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.211022:0:25219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25219:1876371859311744:192.168.206.38@tcp:104: 00010000:00010000:1.0:1789448236.211046:0:25219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448236.211206:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782528 00000100:00100000:3.0:1789448236.211213:0:22731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782528 00010000:00010000:3.0:1789448236.211248:0:22731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 9 pid: 25215 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448236.211296:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 21 00000100:00100000:3.0:1789448236.211305:0:22731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+9:2392:x1876371849782528:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789448236.211318:0:22731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789448236.211348:0:22731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 9 pid: 25215 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.211362:0:22731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 9 pid: 25215 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.211383:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f98750a7/0x6522da1199ce4d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872f9 expref: 9 pid: 25215 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.211399:0:22731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448236.211403:0:22731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789448236.211408:0:22731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.211416:0:22731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.211444:0:22731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789448236.211518:0:22731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2392:x1876371849782528:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 214us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448236.211525:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 21 00010000:00010000:1.0:1789448236.211852:0:25219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211868:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211889:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211908:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211916:0:25219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211923:0:25219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031a00 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:1.0:1789448236.211926:0:25219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211935:0:25219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211948:0:25219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.211956:0:25219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a9c67e/0x6522da1199ce4d8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.212023:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:2389:x1876371849782400:12345-192.168.206.38@tcp:1:lhsmtool_posix.0 Request processed in 11277us (11724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448236.212031:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 26 00000100:00100000:0.0:1789448236.216047:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.216118:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782784 00000100:00100000:1.0:1789448236.216129:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782784 00000100:00100000:1.0:1789448236.216188:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 70 00000100:00100000:1.0:1789448236.216198:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+15:18857:x1876371849782784:12345-192.168.206.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789448236.216283:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.216299:0:22745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.216310:0:22745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.216341:0:22745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.216354:0:22745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 15 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.216367:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22745:1876371859311872:192.168.206.38@tcp:104: 00000100:00100000:1.0:1789448236.216448:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da480 going to sleep for 11 seconds 00000100:00100000:3.0:1789448236.229397:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.229598:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22745:1876371859311872:192.168.206.38@tcp:104: 00010000:00010000:1.0:1789448236.229633:0:22745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448236.229720:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849782912 00000100:00100000:2.0:1789448236.229734:0:22732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849782912 00010000:00010000:2.0:1789448236.229778:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 16 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448236.229816:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 22 00000100:00100000:2.0:1789448236.229825:0:22732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8338380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+16:2391:x1876371849782912:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789448236.229838:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789448236.229844:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 16 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229856:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 16 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229874:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4c67 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb87297 expref: 16 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229888:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448236.229894:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 15 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229902:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229909:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229916:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.229954:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789448236.230004:0:22732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8338380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+15:2391:x1876371849782912:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 180us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.230011:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 22 00010000:00010000:1.0:1789448236.230118:0:22745:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.230127:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.230305:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.230317:0:22745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 15 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.230325:0:22745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.230350:0:22745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 15 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.230362:0:22745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 15 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.230373:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22745:1876371859312000:192.168.206.38@tcp:104: 00000100:00100000:1.0:1789448236.230417:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f82da240 going to sleep for 11 seconds 00000100:00100000:1.0:1789448236.233124:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22745:1876371859312000:192.168.206.38@tcp:104: 00010000:00010000:1.0:1789448236.233154:0:22745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789448236.234676:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448236.235168:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849783040 00000100:00100000:0.0:1789448236.235178:0:22730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849783040 00010000:00010000:0.0:1789448236.235218:0:22730:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 16 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789448236.235248:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:0.0:1789448236.236001:0:22730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+16:2391:x1876371849783040:12345-192.168.206.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789448236.236019:0:22730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789448236.236029:0:22730:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 16 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.236043:0:22730:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 16 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.236063:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8008e00/0x6522da1199ce4d63 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.38@tcp remote: 0x239082f3feb872e4 expref: 16 pid: 22744 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.236077:0:22730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:0.0:1789448236.236082:0:22730:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.236106:0:22730:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.236113:0:22730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.236135:0:22730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789448236.236265:0:22745:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.236273:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789448236.236375:0:22745:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1789448236.236529:0:22745:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1789448236.236566:0:22745:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1789448236.236635:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22745:1876371859312128:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789448236.236686:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448236.236725:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9516c88ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1789448236.236881:0:22730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+18:2391:x1876371849783040:12345-192.168.206.38@tcp:103:ldlm_bl.0 Request processed in 1623us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448236.236890:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:2.0:1789448236.237539:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859312128 00000100:00100000:2.0:1789448236.237549:0:23817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859312128 00000100:00100000:2.0:1789448236.237596:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789448236.237606:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22745:x1876371859312128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789448236.237713:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22745:x1876371859312128:12345-0@lo:1000:mdt00_001.0 Request processed in 108us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448236.237720:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789448236.237951:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22745:1876371859312128:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789448236.238103:0:22745:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1789448236.238162:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22745:1876371859312256:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789448236.238198:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448236.238228:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517f83329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789448236.238284:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859312256 00000100:00100000:2.0:1789448236.238289:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859312256 00000100:00100000:2.0:1789448236.238323:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789448236.238329:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22745:x1876371859312256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789448236.238423:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22745:x1876371859312256:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (225us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1789448236.238430:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789448236.238487:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6408e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22745:1876371859312256:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789448236.238516:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238524:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238530:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238549:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031a00 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.238553:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238560:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238572:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:2.0:1789448236.238575:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789448236.238578:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238584:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031a00/0x6522da1199ce4d9b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238609:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238615:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238620:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238625:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c8009200 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.238627:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238631:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238649:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448236.238651:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789448236.238656:0:22745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238667:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238677:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.238742:0:22745:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031800/0x6522da1199ce4cfa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb872c8 expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789448236.238753:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7450700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22745:1876371859312384:192.168.206.38@tcp:105: 00000100:00100000:2.0:1789448236.238813:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9517d0b13240 going to sleep for 11 seconds 00000100:00100000:0.0:1789448236.244975:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.245346:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7450700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22745:1876371859312384:192.168.206.38@tcp:105: 00010000:00010000:2.0:1789448236.245372:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.245382:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009200/0x6522da1199ce4cf3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.245412:0:22745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.245425:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.245543:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849783168 00000100:00100000:1.0:1789448236.245551:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849783168 00000100:00100000:1.0:1789448236.245643:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 12 00000100:00100000:1.0:1789448236.245653:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+19:18856:x1876371849783168:12345-192.168.206.38@tcp:49:bash.0 00000100:00100000:1.0:1789448236.245932:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+19:18856:x1876371849783168:12345-192.168.206.38@tcp:49:bash.0 Request processed in 280us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448236.245940:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 12 00010000:00010000:2.0:1789448236.245976:0:22745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.245988:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.245994:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246001:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246006:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517fd7e8000 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.246010:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246016:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246027:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448236.246029:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789448236.246033:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246038:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517fd7e8000/0x6522da1199ce4da2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246047:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246053:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246075:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246080:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031400 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:2.0:1789448236.246083:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246090:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246098:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:2.0:1789448236.246100:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789448236.246103:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789448236.246108:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4d94 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22745 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789448236.246303:0:22780:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789448236.246308:0:22780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789448236.246323:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789448236.246329:0:22780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789448236.246404:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+18:18857:x1876371849782784:12345-192.168.206.38@tcp:57:lhsmtool_posix.0 Request processed in 30207us (30364us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1789448236.246412:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 70 00000020:00080000:2.0:1789448236.246416:0:22745:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789448236.255636:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448236.255667:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448236.255695:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849783424 00000100:00100000:0.0:1789448236.255713:0:22748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849783424 00000100:00100000:0.0:1789448236.255757:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 13 00000100:00100000:0.0:1789448236.255772:0:22748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+18:18857:x1876371849783424:12345-192.168.206.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789448236.256026:0:22748:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789448236.256057:0:22748:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1789448236.256090:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256107:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256118:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256127:0:22748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256148:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256154:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256172:0:22748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789448236.256264:0:22748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:18857:x1876371849783424:12345-192.168.206.38@tcp:35:lhsmtool_posix.0 Request processed in 485us (623us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1789448236.256272:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 13 00000020:00080000:0.0:1789448236.256277:0:22748:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789448236.256298:0:22734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789448236.256304:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256312:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9516c7b2e000 already unused, calling callback (ffffffffc0c7a8b0) 00010000:00010000:0.0:1789448236.256316:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256324:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256337:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9517c3700500) 00010000:00010000:0.0:1789448236.256340:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789448236.256344:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256349:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c7b2e000/0x6522da1199ce4da9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256370:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448236.256372:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789448236.256374:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789448236.256384:0:25215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849783552 00000100:00100000:0.0:1789448236.256389:0:25215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849783552 00000100:00100000:0.0:1789448236.256421:0:25215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 27 00000100:00100000:0.0:1789448236.256427:0:25215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+7:18856:x1876371849783552:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:0.0:1789448236.256437:0:25215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789448236.256482:0:25215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df1d495a/0x6522da1199ce4db0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87300 expref: -99 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789448236.256505:0:25215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa8d02b, atime: 0x6aa8d02a, ctime: 0x6aa8d02b, blocks: 0x0 00010000:00010000:0.0:1789448236.256521:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=638s v=(0 0) 00010000:00010000:0.0:1789448236.256526:0:25215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789448236.256533:0:25215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df1d495a/0x6522da1199ce4db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87300 expref: 8 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256546:0:25215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df1d495a/0x6522da1199ce4db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87300 expref: 8 pid: 25215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789448236.256556:0:25215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c7b2e200, rc 0) 00000100:00100000:0.0:1789448236.256576:0:25215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:18856:x1876371849783552:12345-192.168.206.38@tcp:101:bash.0 Request processed in 150us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448236.256582:0:25215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 27 00000100:00100000:0.0:1789448236.261414:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.261533:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849783680 00000100:00100000:3.0:1789448236.261542:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849783680 00000100:00100000:3.0:1789448236.261599:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 71 00000100:00100000:3.0:1789448236.261609:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+20:18856:x1876371849783680:12345-192.168.206.38@tcp:101:bash.0 00010000:00010000:3.0:1789448236.261648:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448236.261667:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009000/0x6522da1199ce4db7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb87307 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.261872:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4dbe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.261888:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4dbe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.261965:0:24273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4dbe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.262106:0:24273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009000/0x6522da1199ce4db7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87307 expref: 22 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.262126:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009800/0x6522da1199ce4dbe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb87307 expref: 21 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.262135:0:24273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:3.0:1789448236.262138:0:24273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789448236.262142:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8009800, rc 0) 00000100:00100000:3.0:1789448236.262249:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+21:18856:x1876371849783680:12345-192.168.206.38@tcp:101:bash.0 Request processed in 640us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448236.262266:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 71 00000100:00100000:0.0:1789448236.269087:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.269202:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849783936 00000100:00100000:2.0:1789448236.269215:0:22748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849783936 00000100:00100000:2.0:1789448236.269376:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 14 00000100:00100000:2.0:1789448236.269388:0:22748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+21:18856:x1876371849783936:12345-192.168.206.38@tcp:35:bash.0 00000001:00080000:2.0:1789448236.269720:0:22748:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1789448236.269824:0:22748:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1789448236.269938:0:22748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+24:18856:x1876371849783936:12345-192.168.206.38@tcp:35:bash.0 Request processed in 551us (859us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1789448236.269947:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 14 00000020:00080000:2.0:1789448236.269952:0:22748:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789448236.429543:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:3.0:1789448236.429640:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849784192 00000100:00100000:3.0:1789448236.429650:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849784192 00000100:00100000:3.0:1789448236.429717:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 72 00000100:00100000:3.0:1789448236.429728:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+24:18867:x1876371849784192:12345-192.168.206.38@tcp:101:lfs.0 00010000:00010000:3.0:1789448236.429780:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789448236.429802:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009000/0x6522da1199ce4dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x239082f3feb8730e expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789448236.430032:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789448236.430135:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009000/0x6522da1199ce4dc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8730e expref: 26 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.430149:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9517c2848700) 00010000:00010000:3.0:1789448236.430152:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789448236.430156:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9516c8009000/0x6522da1199ce4dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.38@tcp remote: 0x239082f3feb8730e expref: 26 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789448236.430169:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9516c8009000, rc 0) 00000100:00100000:3.0:1789448236.430227:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+25:18867:x1876371849784192:12345-192.168.206.38@tcp:101:lfs.0 Request processed in 502us (694us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1789448236.430234:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 72 00000100:00100000:3.0:1789448236.433766:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:1.0:1789448236.436624:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849784320 00000100:00100000:1.0:1789448236.436641:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849784320 00000100:00100000:1.0:1789448236.436764:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 73 00000100:00100000:1.0:1789448236.436785:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c833a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+25:18867:x1876371849784320:12345-192.168.206.38@tcp:34:lfs.0 00010000:00010000:1.0:1789448236.436856:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.436884:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.436903:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.436919:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.436927:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.436934:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437004:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437013:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437020:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789448236.437057:0:22746:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437068:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437096:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437102:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437108:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0030200 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.437112:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437120:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437131:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9517c3700300) 00010000:00010000:1.0:1789448236.437133:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.437138:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437144:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0030200/0x6522da1199ce4dd3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437159:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437165:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437170:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437174:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031200 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.437183:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437190:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437198:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9517c3700100) 00010000:00010000:1.0:1789448236.437200:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.437203:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437208:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031200/0x6522da1199ce4dda lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437221:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437228:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437233:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437238:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9517c0031400 already unused, calling callback (ffffffffc188c4f0) 00010000:00010000:1.0:1789448236.437241:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437247:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437662:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9517c3700e00) 00010000:00010000:1.0:1789448236.437665:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789448236.437677:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789448236.437683:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9517c0031400/0x6522da1199ce4de1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789448236.437819:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c833a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe0e289e-d7a2-4039-8365-2f54416a41ea+25:18867:x1876371849784320:12345-192.168.206.38@tcp:34:lfs.0 Request processed in 980us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448236.437830:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 73 00000100:00100000:0.0:1789448236.441341:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448236.441534:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849784576 00000100:00100000:2.0:1789448236.441544:0:22747:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849784576 00000100:00100000:2.0:1789448236.441602:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 15 00000100:00100000:2.0:1789448236.441612:0:22747:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+25:18867:x1876371849784576:12345-192.168.206.38@tcp:35:lfs.0 00000100:00100000:2.0:1789448236.441817:0:22747:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe0e289e-d7a2-4039-8365-2f54416a41ea+26:18867:x1876371849784576:12345-192.168.206.38@tcp:35:lfs.0 Request processed in 207us (484us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1789448236.441825:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 15 00010000:00010000:3.0:1789448236.663258:0:24277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448237.237615:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789448237.237636:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859312512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789448237.237699:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448237.237740:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859312512 00000100:00100000:2.0:1789448237.237747:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859312512 00000100:00100000:2.0:1789448237.237936:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448237.237944:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859312512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789448237.237970:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448237.238009:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859312512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448237.238015:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789448237.238054:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859312512:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789448237.245665:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789448237.685605:0:22733:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789448237.990176:0:25825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1789448238.262423:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859312640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448238.262693:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448238.262720:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789448238.262737:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859312768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789448238.262754:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859312640 00000100:00100000:2.0:1789448238.262762:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859312640 00000100:00100000:0.0:1789448238.262775:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448238.262810:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859312768 00000100:00100000:2.0:1789448238.262814:0:22749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859312768 00000100:00100000:0.0:1789448238.262833:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789448238.262913:0:23817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859312640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789448238.262945:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789448238.263002:0:23817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859312640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448238.263066:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859312640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789448238.263381:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789448238.263392:0:22749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859312768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789448238.263411:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789448238.263486:0:22749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876371859312768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448238.263494:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789448238.263526:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3635:1876371859312768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789448238.264226:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1789448238.711004:0:22734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789448238.773774:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789448238.773796:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c7451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859312896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789448238.773860:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789448238.773906:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859312896 00000100:00100000:2.0:1789448238.773914:0:24252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859312896 00000100:00100000:2.0:1789448238.773967:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789448238.773977:0:24252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859312896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789448238.773998:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789448238.774039:0:24252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1876371859312896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448238.774045:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789448238.774093:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c7451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3634:1876371859312896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789448238.774233:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789448238.774241:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789448238.774250:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448238.774278:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.774487:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859313152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789448238.774512:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789448238.774580:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313024 00000100:00100000:0.0:1789448238.774585:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313024 00000100:00100000:0.0:1789448238.774617:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313152 00000100:00100000:0.0:1789448238.774620:0:24253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313152 00000100:00100000:0.0:1789448238.774634:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448238.774641:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1876371859313024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789448238.774658:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789448238.774693:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1876371859313024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448238.774698:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789448238.774712:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789448238.774718:0:24253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c640b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859313152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789448238.774727:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789448238.774763:0:24253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c640b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859313152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448238.774785:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789448238.774887:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789448238.774913:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859313152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789448238.774926:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3633:1876371859313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789448238.775160:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c8339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859313280:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775226:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859313792:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775268:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789448238.775273:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859313408:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775292:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775305:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859313920:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775338:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775365:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313792 00000100:00100000:1.0:1789448238.775369:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313792 00000100:00100000:1.0:1789448238.775401:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313408 00000100:00100000:1.0:1789448238.775405:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313408 00000100:00100000:1.0:1789448238.775417:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313920 00000100:00100000:1.0:1789448238.775419:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313920 00000100:00100000:1.0:1789448238.775433:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789448238.775452:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859313792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775516:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876371859313792:12345-0@lo:400:kworker.0 Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448238.775523:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789448238.775537:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789448238.775543:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c6408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859313408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775566:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c6408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876371859313408:12345-0@lo:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448238.775572:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789448238.775583:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789448238.775589:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859313920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775613:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876371859313920:12345-0@lo:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448238.775618:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789448238.775635:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789448238.775638:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789448238.775655:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876371859313408:0@lo:400:kworker.0 00010000:00080000:1.0:1789448238.775666:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9516c770ed80 x1876371859313920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448238.775689:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3634:1876371859313920:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775701:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3634:1876371859313792:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775723:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859313664:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775759:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775777:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859314176:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775797:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775812:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789448238.775817:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859313536:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775839:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775855:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9517ef91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859314048:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775875:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789448238.775891:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313664 00000100:00100000:1.0:1789448238.775895:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313664 00000100:00100000:1.0:1789448238.775912:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859314176 00000100:00100000:1.0:1789448238.775915:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859314176 00000100:00100000:1.0:1789448238.775929:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859314048 00000100:00100000:1.0:1789448238.775932:0:22746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859314048 00000100:00100000:1.0:1789448238.775945:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448238.775951:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859313664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.775983:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1876371859313664:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448238.775988:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789448238.776000:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448238.776007:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859314176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.776045:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1876371859314176:12345-0@lo:400:kworker.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448238.776051:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789448238.776063:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789448238.776069:0:22746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1876371859314048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.776095:0:22746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1876371859314048:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789448238.776101:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789448238.776115:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789448238.776118:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789448238.776135:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3633:1876371859314048:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.776143:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3633:1876371859313664:0@lo:400:kworker.0 00010000:00080000:1.0:1789448238.776152:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9517ef91b100 x1876371859314176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789448254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789448238.776160:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9517ef91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3633:1876371859314176:0@lo:400:kworker.0 00000100:00100000:0.0:1789448238.776307:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313536 00000100:00100000:0.0:1789448238.776312:0:24250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313536 00000100:00100000:0.0:1789448238.776348:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789448238.776355:0:24250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517fd9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859313536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789448238.776395:0:24250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517fd9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1876371859313536:12345-0@lo:400:kworker.0 Request processed in 41us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448238.776401:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789448238.776563:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371859313280 00000100:00100000:3.0:1789448238.776580:0:22738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371859313280 00000100:00100000:3.0:1789448238.776620:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789448238.776627:0:22738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3634:x1876371859313280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789448238.776678:0:22738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:562d8d7b-adf5-44cc-8730-f8665ac1447a+24:3634:x1876371859313280:12345-0@lo:400:kworker.0 Request processed in 52us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789448238.776685:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789448238.776733:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c8339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:562d8d7b-adf5-44cc-8730-f8665ac1447a:3634:1876371859313280:0@lo:400:kworker.0 00000100:00100000:1.0:1789448238.777192:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9516c770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3633:1876371859313536:0@lo:400:kworker.0 00000100:00100000:0.0:1789448239.167590:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448239.167630:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448239.167663:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448239.167685:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448239.167705:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:0.0:1789448239.167727:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849785216 00000100:00100000:0.0:1789448239.167735:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849785216 00000100:00100000:2.0:1789448239.167886:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849784704 00000100:00100000:2.0:1789448239.167890:0:22739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849784704 00000100:00100000:2.0:1789448239.167929:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 166 00000100:00100000:2.0:1789448239.167937:0:22739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:2392:x1876371849784704:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:2.0:1789448239.167996:0:22739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bb619d97-77c9-4e42-a2f4-6c7905f1c791+13:2392:x1876371849784704:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 60us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.168003:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 166 00000100:00100000:0.0:1789448239.168327:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849785728 00000100:00100000:0.0:1789448239.168331:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849785728 00000100:00100000:0.0:1789448239.168366:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:0.0:1789448239.168373:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2392:x1876371849785216:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448239.168404:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+8:2392:x1876371849785216:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 32us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.168410:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 23 00000100:00100000:0.0:1789448239.168422:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 24 00000100:00100000:0.0:1789448239.168428:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c886ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a3f413d-b754-460c-ba19-98579d387b28+5:2392:x1876371849785728:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448239.168487:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c886ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a3f413d-b754-460c-ba19-98579d387b28+5:2392:x1876371849785728:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 38us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.168504:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 24 00000100:00100000:0.0:1789448239.168525:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849784960 00000100:00100000:0.0:1789448239.168529:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849784960 00000100:00100000:0.0:1789448239.168555:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849785472 00000100:00100000:0.0:1789448239.168557:0:24273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849785472 00000100:00100000:0.0:1789448239.168573:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 67 00000100:00100000:0.0:1789448239.168580:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9517ef906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2392:x1876371849784960:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448239.168605:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9517ef906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2392:x1876371849784960:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 26us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.168611:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 67 00000100:00100000:0.0:1789448239.168621:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 68 00000100:00100000:0.0:1789448239.168626:0:24273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c8869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+5:2392:x1876371849785472:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:0.0:1789448239.168643:0:24273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c8869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a3f413d-b754-460c-ba19-98579d387b28+5:2392:x1876371849785472:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 17us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789448239.168649:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 68 00000100:00080000:0.0:1789448239.168664:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789448239.168671:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789448239.169303:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448239.169364:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448239.169394:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448239.169426:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.38@tcp (source: 12345-192.168.206.38@tcp) 00000100:00100000:2.0:1789448239.169524:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849784832 00000100:00100000:2.0:1789448239.169529:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849784832 00000100:00100000:2.0:1789448239.169565:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849785344 00000100:00100000:2.0:1789448239.169568:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849785344 00000100:00100000:2.0:1789448239.169582:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 69 00000100:00100000:2.0:1789448239.169589:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+26:2392:x1876371849784832:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:2.0:1789448239.169634:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe0e289e-d7a2-4039-8365-2f54416a41ea+26:2392:x1876371849784832:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.169641:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 69 00000100:00100000:2.0:1789448239.169656:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 70 00000100:00100000:2.0:1789448239.169662:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:2392:x1876371849785344:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:2.0:1789448239.169687:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a3f413d-b754-460c-ba19-98579d387b28+6:2392:x1876371849785344:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.169693:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 70 00000100:00080000:2.0:1789448239.169710:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789448239.169742:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849785088 00000100:00100000:2.0:1789448239.169746:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849785088 00000100:00100000:2.0:1789448239.170337:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876371849785600 00000100:00100000:2.0:1789448239.170342:0:25219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876371849785600 00000100:00100000:2.0:1789448239.170537:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 25 00000100:00100000:2.0:1789448239.170546:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2392:x1876371849785088:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:2.0:1789448239.170582:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fe0e289e-d7a2-4039-8365-2f54416a41ea+5:2392:x1876371849785088:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 38us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.170589:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 25 00000100:00100000:2.0:1789448239.170602:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.38@tcp, seq: 26 00000100:00100000:2.0:1789448239.170609:0:25219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9516c7452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a3f413d-b754-460c-ba19-98579d387b28+5:2392:x1876371849785600:12345-192.168.206.38@tcp:400:kworker.0 00000100:00100000:2.0:1789448239.170647:0:25219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9516c7452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a3f413d-b754-460c-ba19-98579d387b28+5:2392:x1876371849785600:12345-192.168.206.38@tcp:400:kworker.0 Request processed in 39us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789448239.170653:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.38@tcp, seq: 26 00000100:00080000:0.0:1789448239.171524:0:22741:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 14376 lines, 14376 kept, 0 dropped, 0 bad.